-- Logs begin at Fri 2021-04-09 01:11:32 UTC, end at Fri 2021-04-09 02:12:32 UTC. -- Apr 09 01:45:18.656964 dv-cinder-784623-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 09 01:45:18.665018 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Apr 9 01:45:18 2021] *** Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: nodename: dv-cinder-784623-6-iscsi Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: machine: x86_64 Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: clock source: unix Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: pcre jit disabled Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: detected number of CPU cores: 4 Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: current working directory: / Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: detected binary path: /usr/bin/uwsgi-core Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: dropping root privileges as early as possible Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: your processes number limit is 47843 Apr 09 01:45:18.667132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: your memory page size is 4096 bytes Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: detected max file descriptor number: 2048 Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: lock engine: pthread robust mutexes Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: thunder lock: enabled Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: dropping root privileges after socket binding Apr 09 01:45:18.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 09 01:45:18.714790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: Python main interpreter initialized at 0x5576c79609c0 Apr 09 01:45:18.714790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: dropping root privileges after plugin initialization Apr 09 01:45:18.714790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: python threads support enabled Apr 09 01:45:18.714790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: your server socket listen backlog is limited to 100 connections Apr 09 01:45:18.714790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: your mercy for graceful operations on workers is 90 seconds Apr 09 01:45:18.715323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: mapped 402621 bytes (393 KB) for 2 cores Apr 09 01:45:18.715323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: *** Operational MODE: preforking *** Apr 09 01:45:18.716053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: dropping root privileges after application loading Apr 09 01:45:18.716053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: *** uWSGI is running in multiple interpreter mode *** Apr 09 01:45:18.716053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: spawned uWSGI master process (pid: 84564) Apr 09 01:45:18.716096 dv-cinder-784623-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 09 01:45:18.716470 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: spawned uWSGI worker 1 (pid: 84565, cores: 1) Apr 09 01:45:18.716895 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: spawned uWSGI worker 2 (pid: 84566, cores: 1) Apr 09 01:45:18.716895 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 09 01:45:23.474079 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 09 01:45:23.474645 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 09 01:45:23.476209 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 09 01:45:23.476646 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 09 01:45:23.476934 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 09 01:45:23.477396 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.477762 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.477929 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 09 01:45:23.478123 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.478221 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 09 01:45:23.478484 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.478861 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.479211 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.479571 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.479797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 09 01:45:23.479906 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.480264 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 09 01:45:23.480363 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.480566 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 09 01:45:23.480670 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.480917 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.481050 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.481325 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-6-iscsi {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.481440 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.481694 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.481792 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482040 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482145 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482389 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482495 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482752 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.482858 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483095 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483202 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483472 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483575 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483858 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.483962 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.484189 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.484507 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.484621 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.484857 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.484968 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-6-iscsi {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.485202 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.485308 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.485551 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.485669 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.485920 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486079 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486374 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486608 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486721 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.486973 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.487091 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.487321 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.487437 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.487680 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.487957 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.488132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.488339 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.488438 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-6-iscsi {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.488693 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.488792 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489063 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489179 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489413 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489519 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489784 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.489888 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490140 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490247 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490514 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490618 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490869 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.490954 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.491228 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.491350 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.491573 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.491672 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.491940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-6-iscsi {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.492060 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.492327 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.492427 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.492678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.492794 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493033 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493144 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493373 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493519 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493718 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.493877 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494065 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494236 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494426 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494610 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494767 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.494985 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.495092 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.495341 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.495446 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.495677 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.495777 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.496063 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.496168 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.496431 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.496537 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497314 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497426 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497593 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497706 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497877 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.497984 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.498244 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.498517 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.498631 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.498726 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.498913 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499021 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499258 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499363 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499578 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499684 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.499921 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500040 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500294 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500403 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500637 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500736 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.500980 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501080 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501581 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501693 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.501954 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.502053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.502326 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.502436 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.502668 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.502773 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503013 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503113 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503372 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503497 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503711 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.503813 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504079 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504189 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504431 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504532 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504784 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.504890 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505121 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505227 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505480 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505579 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505837 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.505943 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506173 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506278 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506616 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506857 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.506955 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.507218 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.507317 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.507571 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.507670 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.507904 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508037 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508215 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508330 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508551 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508657 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.508893 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509009 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509254 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509361 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509594 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509702 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.509937 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510044 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510278 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510384 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510613 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510722 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.510955 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511063 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511296 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511402 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511641 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511753 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.511939 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.512139 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.512370 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.512956 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513216 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513322 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513550 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513658 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513891 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.513996 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.514229 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.514328 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.514575 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.514674 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.514926 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515026 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515260 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515365 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515702 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.515943 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516075 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516313 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516422 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516658 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516758 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.516998 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.517104 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.517335 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.517435 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.517678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.517785 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518012 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518116 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518352 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518452 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518711 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.518818 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519056 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519155 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519391 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519490 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519733 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.519838 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520092 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520195 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520435 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520535 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.520908 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521234 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521478 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521614 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521819 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.521931 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522157 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522256 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522495 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522594 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522833 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.522931 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523172 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523270 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523518 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523646 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523846 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.523956 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.524217 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.524316 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.524582 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.524716 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.524918 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525039 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525257 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525355 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525597 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525696 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.525950 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.526038 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.526321 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.526415 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.526647 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.526765 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.527010 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.527105 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.527342 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.527456 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.527689 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.527817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.528111 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.528226 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.528469 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.528574 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.528817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.528930 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.529161 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.529268 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.529501 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.529606 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.529853 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.529961 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:45:23.530203 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.530301 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.530549 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.530655 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.530914 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.531015 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.531271 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.531370 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.531649 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.531766 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532017 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532137 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532386 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532494 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532735 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.532842 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533084 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533193 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533439 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533546 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533789 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.533904 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534142 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534256 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534490 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534606 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534861 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.534974 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.535229 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.535337 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.535571 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.535685 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.535940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.536078 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.536322 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.536431 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.536681 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.536807 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537033 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537131 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537377 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537485 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537728 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.537838 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538083 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538181 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538434 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538532 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538779 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.538887 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539158 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539256 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539513 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539616 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539863 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.539969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.540235 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.540344 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.540582 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.540681 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.540926 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541023 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541274 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541372 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541622 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541745 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.541988 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.542111 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.542341 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.542441 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.542678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.542778 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.543058 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.543158 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.543402 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544015 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544296 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544447 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544647 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544758 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.544985 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.545115 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.545332 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.545442 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.545673 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.545773 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546015 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546122 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546381 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546493 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546727 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.546846 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547066 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547174 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547428 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547540 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547779 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.547904 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548146 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548492 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548592 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548839 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.548939 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549182 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549283 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549634 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549873 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.549974 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.550220 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.550321 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.550569 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.550669 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.550914 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551014 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551285 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551385 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551620 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551755 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.551965 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.552112 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.552366 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.552467 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.552717 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.552817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553062 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553162 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553411 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553516 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553752 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.553851 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554092 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554202 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554432 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554542 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554780 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.554879 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555123 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555241 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555488 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555649 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555868 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.555973 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.556269 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.556393 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.556641 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.556772 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557014 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557127 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557333 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557459 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557680 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.557792 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558015 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558140 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558357 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558467 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558705 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.558810 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.559057 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.559156 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.559976 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.560159 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.560371 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.560524 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.560736 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.560886 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561098 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561252 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561446 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561792 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.561955 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.562127 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.562392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.562559 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.562722 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.562880 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563030 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563228 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563377 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563691 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.563852 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564045 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564150 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564378 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564479 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564755 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.564854 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565094 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565205 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565441 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565542 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.565896 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566133 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566242 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566481 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566582 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566830 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.566934 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.567176 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.567289 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.567515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.567621 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.567865 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568017 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568237 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568339 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568587 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568688 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.568936 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569043 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569280 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569380 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569632 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569739 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.569971 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.570083 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.570313 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.570413 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.570655 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.570755 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571004 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571167 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571349 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571455 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571689 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.571797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572042 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572168 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572405 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572511 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572740 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.572845 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573085 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573192 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573433 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573532 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573775 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.573874 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574118 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574217 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574461 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574560 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.574966 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575173 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575534 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575634 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575876 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.575975 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.576261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.576362 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.576622 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.576723 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.576969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.577073 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.577313 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.577425 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.577659 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.577761 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578010 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578354 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578471 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578697 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.578797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579041 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579204 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579384 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579490 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579731 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.579840 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580103 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580224 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580453 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580554 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.580917 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581158 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581276 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581507 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581608 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581857 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.581957 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.582195 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.582305 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.582545 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.582652 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.582898 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.583003 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.583257 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.583593 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.583693 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.583947 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.584072 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.584331 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.584442 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.584685 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.584800 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585046 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585146 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585393 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585501 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585751 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.585850 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586108 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586208 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586453 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586561 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586798 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.586905 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.587147 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.587256 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.587496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.587839 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.587940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.588218 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.588322 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.588561 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.588674 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.588905 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589006 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589250 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589391 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589597 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589706 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.589943 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.590043 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.590284 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.590384 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.590654 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.590762 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591000 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591100 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591352 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591458 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591685 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.591796 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592048 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592163 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592407 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592511 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592759 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.592861 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593103 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593203 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593448 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593548 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593781 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.593882 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594123 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594229 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594465 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594565 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.594917 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.595170 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.595269 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.595533 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.595632 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.595887 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596003 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596258 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596358 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596602 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596714 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.596965 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597137 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597310 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597410 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597655 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597780 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.597995 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.598096 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.598335 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.598438 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.598676 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.598784 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.599025 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.599126 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.599385 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.599484 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.599981 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.600164 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.600366 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.600471 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.600714 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.600813 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601059 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601159 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601418 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601517 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601767 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.601869 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602097 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602197 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602446 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602545 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602798 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.602918 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603239 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603475 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603576 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603832 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.603933 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604202 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604305 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604544 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604643 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604883 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.604991 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.605223 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.605331 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.605563 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.605664 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.605906 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.606493 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.606772 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.606872 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607120 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607226 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607467 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607574 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607816 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.607928 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.608179 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.608281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.608594 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.608732 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.608873 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609006 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609216 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609553 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609669 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609896 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.609994 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.610242 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.610351 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.610582 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.610698 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.610923 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611027 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611289 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611388 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611629 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611729 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.611973 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.612094 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.612343 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.612455 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.612684 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.612803 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613030 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613191 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613388 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613540 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613743 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.613906 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614094 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614246 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614437 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614595 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614770 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.614925 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.615079 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.615228 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.615433 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.615596 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.615848 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616061 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616178 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616276 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616512 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616621 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616854 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.616955 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.617186 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.617316 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.617550 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.617662 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.617899 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618018 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618242 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618342 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618605 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618717 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.618969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.619069 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.619320 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.619426 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.619655 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.619762 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620024 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620155 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620374 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620475 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620721 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.620822 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.621065 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.621172 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.621405 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.621505 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.622307 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.622414 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.622658 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.622758 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623009 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623124 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623350 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623451 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623698 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.623797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624088 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624192 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624436 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624543 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624776 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.624876 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625123 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625225 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625472 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625573 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625811 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.625911 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626155 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626263 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626503 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626844 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.626944 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.627195 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.627301 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.627530 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.627638 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.627885 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628102 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628274 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628389 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628631 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628788 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.628995 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.629114 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.629331 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.629441 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.629680 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.629780 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630028 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630132 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630374 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630489 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630720 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.630828 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631062 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631171 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631421 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631542 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631774 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.631884 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.632182 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.632296 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.632528 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.632634 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.632881 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633071 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633228 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633350 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633597 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633698 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.633940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634038 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634282 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634380 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634625 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634724 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.634969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.635068 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.635308 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.635455 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.635670 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.635815 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636170 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636272 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636521 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636639 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636868 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.636966 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.637220 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.637357 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.637603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.637721 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.637981 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.638100 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.638334 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.638443 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.638687 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.638806 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639039 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639159 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639374 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639474 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639726 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.639855 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640096 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640209 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640468 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640580 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640830 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.640941 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.641180 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.641281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.641534 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.641684 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.641874 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642049 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642223 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642410 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642598 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642796 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.642946 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.643183 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.643316 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.643554 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.643753 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.643907 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644173 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644274 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644527 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644647 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644875 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.644998 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.645246 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.645353 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.645590 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.645699 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.645932 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646096 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646381 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646626 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646725 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.646969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.647081 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.647335 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.647435 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.647682 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.647799 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648048 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648177 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648403 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648750 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.648856 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649093 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649197 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649434 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649540 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649796 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.649896 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650138 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650238 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650509 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650627 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650855 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.650954 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.651210 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.651310 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.651567 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.651666 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.651911 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.652036 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.652302 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.652403 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.652650 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.652751 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653021 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653124 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653363 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653469 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653702 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.653807 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654069 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654176 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654403 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654503 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654762 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.654862 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655125 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655232 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655490 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655590 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655839 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.655938 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.656213 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.656326 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.656591 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.656701 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.656940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657040 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657285 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657636 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657749 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.657972 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.658072 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.658315 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.658433 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.658662 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.658774 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659003 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659119 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659345 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659448 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659686 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.659786 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660166 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660396 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660736 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.660868 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661077 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661194 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661472 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661590 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661785 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.661884 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662149 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662248 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662608 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662835 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.662940 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663176 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663276 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663624 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663859 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.663959 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.664243 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.664353 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.664594 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.664704 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.664944 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.665043 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.665293 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.665393 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.665657 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.665757 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666000 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666100 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666360 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666460 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666706 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.666829 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667050 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667160 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667500 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667739 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.667825 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.668121 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.668233 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.668474 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.669086 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.669344 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.669425 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.669693 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.669799 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670047 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670155 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670401 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670501 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670751 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.670852 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.671130 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.671356 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.671496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.671725 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.671908 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.672111 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.672221 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.672432 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.672587 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.672783 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673033 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673142 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673290 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673468 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673654 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.673790 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674013 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674122 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674377 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674479 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674741 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.674842 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.675107 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.675216 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.675468 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.675723 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.675822 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676144 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676259 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676512 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676625 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676873 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.676982 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.677225 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.677325 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.677583 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.677683 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.677936 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678062 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678295 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678405 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678640 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678742 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.678991 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.679091 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.679341 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.679455 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.679696 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.679797 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680076 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680180 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680430 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680542 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680786 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.680933 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681136 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681236 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681491 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681592 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681841 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.681942 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.682193 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.682293 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.682554 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.682655 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.682925 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.683026 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.683281 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.683397 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.683647 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.683748 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.684027 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.684142 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.684932 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.685041 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.685293 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.685399 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.685661 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.685876 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686021 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686235 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686388 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686614 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686733 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.686990 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.687103 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.687358 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.687459 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.687714 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.687814 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688130 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688247 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688494 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688601 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688843 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.688943 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689187 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689294 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689519 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689675 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689864 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.689965 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.690209 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.690455 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.690562 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.690819 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.690920 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.691205 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.691306 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.691556 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.691657 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.691904 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.692028 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.692298 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.692546 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.692648 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.692953 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.693053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.693318 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.693418 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.693667 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.693768 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694026 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694136 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694377 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694478 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694723 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.694824 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695083 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695183 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695429 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695536 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695771 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.695878 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.696145 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.696277 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.696497 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.696608 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.696833 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697130 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697243 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697500 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697600 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697848 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.697949 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698190 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698291 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698538 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698644 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698879 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.698981 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.699238 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.699338 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.699576 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.699707 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.699949 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.700067 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.700323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.700423 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.700676 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.700776 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701013 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701115 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701360 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701460 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701698 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.701805 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702042 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702142 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702389 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702488 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702725 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.702832 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703072 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703172 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703415 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703759 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.703867 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704130 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704236 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704478 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704579 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704814 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.704922 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705171 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705271 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705507 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705606 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705850 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.705958 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706195 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706295 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706536 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706635 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706887 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.706987 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.707230 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.707349 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.707577 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.707678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.707932 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.708048 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.708320 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.708421 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.708675 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.708935 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.709051 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.709316 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.709417 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.709678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.709777 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710032 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710151 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710385 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710485 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710739 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.710838 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711085 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711191 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711430 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711782 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.711883 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712149 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712252 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712501 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712601 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712849 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.712950 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.713201 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.713465 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.713566 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.713852 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.713951 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714189 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714310 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714537 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714637 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714885 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.714985 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.715233 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.715334 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.715635 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.715741 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716013 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716103 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716373 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716480 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716721 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.716822 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717074 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717188 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717416 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717525 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717765 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.717866 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718107 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718207 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718457 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718558 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718803 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.718903 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.719150 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.719258 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.719507 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.719607 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.719843 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720062 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720259 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720372 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720626 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720727 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.720998 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.721106 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.721351 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.721473 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.721697 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.721798 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722049 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722149 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722412 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722524 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722772 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.722872 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723137 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723243 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723480 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723585 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723827 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.723937 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.724244 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.724351 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.724547 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.724649 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.725183 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.725291 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.725566 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.725666 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.725924 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726026 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726289 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726389 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726637 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726745 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.726991 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.727092 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.727340 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.727496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.727692 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.727801 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728064 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728169 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728417 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728564 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728778 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.728888 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729129 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729239 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729477 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729583 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729827 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.729935 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.730199 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.730334 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.730546 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.730651 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.730903 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.731496 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.731760 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.731873 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732136 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732252 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732489 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732590 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732843 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.732942 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.733204 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.733306 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.733549 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.733679 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.733910 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734012 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734260 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734617 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734724 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.734959 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.735059 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.735325 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.735425 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.735683 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.735783 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736057 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736162 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736409 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736520 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736765 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.736870 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737108 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737211 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737463 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737559 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737810 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.737921 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738160 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738259 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738626 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738854 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.738963 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.739219 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.739318 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.739578 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.739686 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.739923 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.740038 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.740314 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.740428 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.740664 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.740765 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741015 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741119 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741367 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741517 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741723 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.741834 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742069 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742175 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742413 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742519 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742763 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.742864 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743102 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743202 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743452 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743559 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743817 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.743945 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.744190 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.744291 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.744561 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.744692 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.744903 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745025 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745259 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745361 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745626 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745744 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.745975 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.746075 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.746334 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.746433 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.747255 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.747372 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.747620 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.747737 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.747890 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84565) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 09 01:45:23.748021 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.748341 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.748702 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.749067 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.749433 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.749811 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.750188 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.750566 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.750944 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.751346 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.751707 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.752129 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.752515 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:45:23.752803 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84566) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 09 01:45:23.783406 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84565) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:23.787755 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84566) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.055540 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.context [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1fd6123a-d6c7-4733-89a5-8079297c7441(cell1) {{(pid=84565) load_cells /opt/stack/nova/nova/context.py:466}} Apr 09 01:45:24.060111 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.context [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1fd6123a-d6c7-4733-89a5-8079297c7441(cell1) {{(pid=84566) load_cells /opt/stack/nova/nova/context.py:466}} Apr 09 01:45:24.061049 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:45:24.062892 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:45:24.063773 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:45:24.065652 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84566) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:45:24.065951 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:45:24.067498 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84566) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:45:24.068425 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84566) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:45:24.070553 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84566) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:45:24.097276 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84566) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.098789 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84565) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.109039 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84565) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.110294 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84566) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.145064 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84565) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.146143 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_db.sqlalchemy.engines [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84566) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:45:24.247397 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:45:24.247397 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: from cryptography.utils import int_from_bytes Apr 09 01:45:24.247786 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:45:24.247786 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: from cryptography.utils import int_from_bytes Apr 09 01:45:24.252787 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:45:24.252787 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: from cryptography.utils import int_from_bytes Apr 09 01:45:24.253186 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:45:24.253186 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: from cryptography.utils import int_from_bytes Apr 09 01:45:24.325932 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading Gnome Apr 09 01:45:24.330777 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading Gnome Apr 09 01:45:24.347057 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading Google Apr 09 01:45:24.350833 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading Windows (alt) Apr 09 01:45:24.351969 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading Google Apr 09 01:45:24.355442 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading Windows (alt) Apr 09 01:45:24.355585 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading file Apr 09 01:45:24.356642 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading keyczar Apr 09 01:45:24.357105 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading multi Apr 09 01:45:24.357978 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Loading pyfs Apr 09 01:45:24.360197 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading file Apr 09 01:45:24.361289 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading keyczar Apr 09 01:45:24.361749 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading multi Apr 09 01:45:24.362645 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO keyring.backend [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Loading pyfs Apr 09 01:45:24.641565 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:45:24.644746 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:45:24.648785 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:45:24.651895 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:45:24.985360 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:45:24.987610 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:45:24.991122 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:45:24.993364 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WARNING keystonemiddleware.auth_token [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:45:24.996892 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576c79609c0 pid: 84565 (default app) Apr 09 01:45:24.999055 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576c79609c0 pid: 84566 (default app) Apr 09 01:45:24.999172 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:45:25.000325 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-d164a1a4-5ef6-4e44-9b9a-a10317c671bb None None] 10.222.0.38 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 Apr 09 01:45:25.000765 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 1/1] 10.222.0.38 () {50 vars in 779 bytes} [Fri Apr 9 01:45:24 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:46:56.462695 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:46:56.465006 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003775 Apr 09 01:46:56.465811 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 1/2] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:46:56 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:46:57.367422 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-a24a9939-de25-4a2a-a60a-548b21653618 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:46:57.423519 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-a24a9939-de25-4a2a-a60a-548b21653618 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.945213 Apr 09 01:46:57.427581 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 2/3] 10.222.0.38 () {60 vars in 1281 bytes} [Fri Apr 9 01:46:56 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:01.005391 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:01.007145 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-ed4b20d8-0003-4306-b328-e5a76d39d51d None None] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002482 Apr 09 01:47:01.008243 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 2/4] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:01 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:01.095766 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-64e94b82-b7e4-4590-80c8-f71b814e683b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:01.133732 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:47:01.133732 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:47:01.173173 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-64e94b82-b7e4-4590-80c8-f71b814e683b admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.154201 Apr 09 01:47:01.178618 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 3/5] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:01 2021] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:01.431528 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-9ce3c032-b191-47ae-8a6d-57bebda45ab4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:01.435603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:47:01.435603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:47:01.481261 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-9ce3c032-b191-47ae-8a6d-57bebda45ab4 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294490 Apr 09 01:47:01.482675 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 3/6] 10.222.0.38 () {64 vars in 1325 bytes} [Fri Apr 9 01:47:01 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:04.162512 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-64e94b82-b7e4-4590-80c8-f71b814e683b admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:04.163614 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-64e94b82-b7e4-4590-80c8-f71b814e683b admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Apr 09 01:47:04.164253 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 4/7] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:04.292910 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0f981292-263a-4339-8ddc-4720f4bcd6b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:04.317001 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:47:04.317001 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:47:04.349603 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0f981292-263a-4339-8ddc-4720f4bcd6b6 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.177379 Apr 09 01:47:04.350500 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 4/8] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:04.364232 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-103f282e-318e-49e0-9edf-8a0a7096dfc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:04.366323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:47:04.366323 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:47:04.405503 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-103f282e-318e-49e0-9edf-8a0a7096dfc7 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045458 Apr 09 01:47:04.416078 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 5/9] 10.222.0.38 () {64 vars in 1325 bytes} [Fri Apr 9 01:47:04 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:07.023514 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0f981292-263a-4339-8ddc-4720f4bcd6b6 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:07.024639 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0f981292-263a-4339-8ddc-4720f4bcd6b6 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Apr 09 01:47:07.025084 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 5/10] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:07.094960 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-73c2dbef-1842-4a4c-9761-69d65287fbf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:07.122181 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-73c2dbef-1842-4a4c-9761-69d65287fbf8 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089755 Apr 09 01:47:07.122832 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 6/11] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:07.137584 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-3b316c99-d4bb-41b7-9a48-70b94c24af84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:07.179724 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-3b316c99-d4bb-41b7-9a48-70b94c24af84 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046722 Apr 09 01:47:07.180592 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 6/12] 10.222.0.38 () {64 vars in 1325 bytes} [Fri Apr 9 01:47:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:10.230105 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-73c2dbef-1842-4a4c-9761-69d65287fbf8 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:10.231302 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-73c2dbef-1842-4a4c-9761-69d65287fbf8 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002686 Apr 09 01:47:10.232167 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 7/13] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:10 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:10.297623 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-6a42fc41-192d-4051-a090-5d86d3612233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:10.329312 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-6a42fc41-192d-4051-a090-5d86d3612233 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089590 Apr 09 01:47:10.330150 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 7/14] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 01:47:10.345755 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-f6cac0b2-441f-4650-bca7-ea34445d7708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:10.386347 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-f6cac0b2-441f-4650-bca7-ea34445d7708 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044513 Apr 09 01:47:10.396031 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 8/15] 10.222.0.38 () {64 vars in 1325 bytes} [Fri Apr 9 01:47:10 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:13.578144 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-6a42fc41-192d-4051-a090-5d86d3612233 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:13.579241 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-6a42fc41-192d-4051-a090-5d86d3612233 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001828 Apr 09 01:47:13.579713 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 8/16] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:13.709032 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "id": "d4", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:13.741899 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149847 Apr 09 01:47:13.742526 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 9/17] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:13.756984 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-7370d7ed-e3b6-4eba-84c1-74a42101b230 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:13.805469 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-7370d7ed-e3b6-4eba-84c1-74a42101b230 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053044 Apr 09 01:47:13.806120 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 9/18] 10.222.0.38 () {64 vars in 1325 bytes} [Fri Apr 9 01:47:13 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:47:16.382241 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:16.383402 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Apr 09 01:47:16.383844 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 10/19] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:16.451848 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-28543177-90df-453f-8810-14012e921753 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:16.482946 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-28543177-90df-453f-8810-14012e921753 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090504 Apr 09 01:47:16.483495 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 10/20] 10.222.0.38 () {60 vars in 1281 bytes} [Fri Apr 9 01:47:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:47:19.050572 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:19.051644 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-bbd27a2e-2bed-4789-98f8-2f615cf19688 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Apr 09 01:47:19.052124 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 11/21] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:47:19.116630 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-41b737d8-a35f-4c11-92ac-9c9f2fecc8b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "id": "1"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:19.142171 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-41b737d8-a35f-4c11-92ac-9c9f2fecc8b6 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083297 Apr 09 01:47:19.142810 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 11/22] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:19 2021] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:19.156164 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-a6461da1-100d-4cca-921c-2ac214e99274 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:19.195705 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-a6461da1-100d-4cca-921c-2ac214e99274 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043268 Apr 09 01:47:19.196535 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 12/23] 10.222.0.38 () {64 vars in 1322 bytes} [Fri Apr 9 01:47:19 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:47:21.852424 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-41b737d8-a35f-4c11-92ac-9c9f2fecc8b6 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:21.854705 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-41b737d8-a35f-4c11-92ac-9c9f2fecc8b6 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002666 Apr 09 01:47:21.855260 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 12/24] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:21 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:21.923107 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-08736131-4cf1-494c-9144-589f7cfaac00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:21.948161 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-08736131-4cf1-494c-9144-589f7cfaac00 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085078 Apr 09 01:47:21.948782 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 13/25] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:21.961517 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4e001903-871c-445e-8e25-b4b75b15cb6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:21.999207 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-4e001903-871c-445e-8e25-b4b75b15cb6d admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041635 Apr 09 01:47:21.999856 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 13/26] 10.222.0.38 () {64 vars in 1322 bytes} [Fri Apr 9 01:47:21 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:24.549633 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-08736131-4cf1-494c-9144-589f7cfaac00 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:24.550892 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-08736131-4cf1-494c-9144-589f7cfaac00 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Apr 09 01:47:24.551420 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 14/27] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:24.615771 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-177b82ee-2d49-41bc-8f85-56c6e0d2d0d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "id": "3", "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:24.640748 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-177b82ee-2d49-41bc-8f85-56c6e0d2d0d6 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081650 Apr 09 01:47:24.641359 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 14/28] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:24 2021] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:24.654616 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-a8507444-35dc-45b5-a5ef-a53eb44906de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:24.692980 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-a8507444-35dc-45b5-a5ef-a53eb44906de admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042580 Apr 09 01:47:24.693634 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 15/29] 10.222.0.38 () {64 vars in 1322 bytes} [Fri Apr 9 01:47:24 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:47:27.284911 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-177b82ee-2d49-41bc-8f85-56c6e0d2d0d6 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:27.285995 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-177b82ee-2d49-41bc-8f85-56c6e0d2d0d6 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Apr 09 01:47:27.286416 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 15/30] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:27.354672 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-a6137eca-6578-4c56-9fdf-959ea0d52c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "id": "4", "os-flavor-access:is_public": true}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:27.387644 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-a6137eca-6578-4c56-9fdf-959ea0d52c27 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093939 Apr 09 01:47:27.389179 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 16/31] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:47:27.402100 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-6979361d-ff66-40be-bc6a-f6119fbe58dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:27.453683 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-6979361d-ff66-40be-bc6a-f6119fbe58dd admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056323 Apr 09 01:47:27.454802 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 16/32] 10.222.0.38 () {64 vars in 1322 bytes} [Fri Apr 9 01:47:27 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:47:30.134713 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-a6137eca-6578-4c56-9fdf-959ea0d52c27 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:47:30.135769 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-a6137eca-6578-4c56-9fdf-959ea0d52c27 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Apr 09 01:47:30.136541 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 17/33] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:47:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:47:30.223392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:30.257839 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.114136 Apr 09 01:47:30.258890 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 17/34] 10.222.0.38 () {64 vars in 1272 bytes} [Fri Apr 9 01:47:30 2021] POST /compute/v2.1/flavors => generated 408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 01:47:30.272738 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-b281059e-1a32-466a-954c-1e2158984be1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:47:30.317389 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-b281059e-1a32-466a-954c-1e2158984be1 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048554 Apr 09 01:47:30.318269 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 18/35] 10.222.0.38 () {64 vars in 1322 bytes} [Fri Apr 9 01:47:30 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:48:12.603183 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:12.604324 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Apr 09 01:48:12.604778 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 18/36] 10.222.0.38 () {54 vars in 920 bytes} [Fri Apr 9 01:48:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:12.665265 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-222dd863-fb04-401d-bf7b-294f63c1a804 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:12.690837 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-222dd863-fb04-401d-bf7b-294f63c1a804 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079588 Apr 09 01:48:12.691425 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 19/37] 10.222.0.38 () {60 vars in 1281 bytes} [Fri Apr 9 01:48:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:14.382883 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:14.384618 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-4f6247ea-745a-4f63-aac7-47f18eee4079 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Apr 09 01:48:14.385071 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 19/38] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:14.570850 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-21241a1c-1d3f-434e-aaee-c7b5ffe53a09 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:14.585143 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-21241a1c-1d3f-434e-aaee-c7b5ffe53a09 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 09 01:48:14.585728 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-21241a1c-1d3f-434e-aaee-c7b5ffe53a09 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:14.586594 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-21241a1c-1d3f-434e-aaee-c7b5ffe53a09 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.071707 Apr 09 01:48:14.587165 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 20/39] 10.222.0.38 () {60 vars in 1181 bytes} [Fri Apr 9 01:48:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:14.597191 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-fadc7b82-8d24-4f2b-9dea-2a70199c7d90 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:14.620493 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-fadc7b82-8d24-4f2b-9dea-2a70199c7d90 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027039 Apr 09 01:48:14.621093 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 20/40] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:14.631552 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-14fb867e-06e0-454a-bacc-f0b268682f35 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:14.655483 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-14fb867e-06e0-454a-bacc-f0b268682f35 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027653 Apr 09 01:48:14.656085 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 21/41] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:14.666622 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-f251ac32-9f86-449c-a069-c8cf54b6e3bd admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:14.683369 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-f251ac32-9f86-449c-a069-c8cf54b6e3bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 09 01:48:14.684032 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-f251ac32-9f86-449c-a069-c8cf54b6e3bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:14.684879 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-f251ac32-9f86-449c-a069-c8cf54b6e3bd admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.022606 Apr 09 01:48:14.685430 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 21/42] 10.222.0.38 () {60 vars in 1181 bytes} [Fri Apr 9 01:48:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:16.260099 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-14fb867e-06e0-454a-bacc-f0b268682f35 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:16.261179 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-14fb867e-06e0-454a-bacc-f0b268682f35 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 09 01:48:16.261620 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 22/43] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:16.445153 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4ab2b712-aef5-4dcf-a8e3-595a84242705 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:16.458740 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-4ab2b712-aef5-4dcf-a8e3-595a84242705 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 09 01:48:16.459375 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-4ab2b712-aef5-4dcf-a8e3-595a84242705 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:16.460337 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-4ab2b712-aef5-4dcf-a8e3-595a84242705 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.070758 Apr 09 01:48:16.460872 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 22/44] 10.222.0.38 () {60 vars in 1181 bytes} [Fri Apr 9 01:48:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:16.470928 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-d4889e94-1644-4fb6-b030-ada8eaf3c0e9 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:16.493241 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-d4889e94-1644-4fb6-b030-ada8eaf3c0e9 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025601 Apr 09 01:48:16.493836 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 23/45] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:16.504133 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-eb984881-217c-49ef-93e7-8819b05e7fba admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:16.526266 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-eb984881-217c-49ef-93e7-8819b05e7fba admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025943 Apr 09 01:48:16.526838 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 23/46] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:16.536950 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-cfa0af39-54c3-4bc8-8da7-83a1c7bff872 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:16.549783 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-cfa0af39-54c3-4bc8-8da7-83a1c7bff872 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 09 01:48:16.550392 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-cfa0af39-54c3-4bc8-8da7-83a1c7bff872 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:16.551243 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-cfa0af39-54c3-4bc8-8da7-83a1c7bff872 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018217 Apr 09 01:48:16.551801 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 24/47] 10.222.0.38 () {60 vars in 1181 bytes} [Fri Apr 9 01:48:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:18.147582 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-eb984881-217c-49ef-93e7-8819b05e7fba admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:18.148751 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-eb984881-217c-49ef-93e7-8819b05e7fba admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Apr 09 01:48:18.149607 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 24/48] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:18.334229 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-f7a218f0-071a-486d-ac95-37a2812973ac admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:18.347161 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-f7a218f0-071a-486d-ac95-37a2812973ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 09 01:48:18.347803 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-f7a218f0-071a-486d-ac95-37a2812973ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84565) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:18.348697 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-f7a218f0-071a-486d-ac95-37a2812973ac admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.068784 Apr 09 01:48:18.349258 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 25/49] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:48:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:18.360240 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-2584e163-df6c-4345-bc56-7d134ed2a014 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:18.382412 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-2584e163-df6c-4345-bc56-7d134ed2a014 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026142 Apr 09 01:48:18.382990 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 25/50] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:18.393523 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:18.415359 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025162 Apr 09 01:48:18.415942 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 26/51] 10.222.0.38 () {60 vars in 1201 bytes} [Fri Apr 9 01:48:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:48:18.426213 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-18f5ecdf-e08b-463a-8484-e8b655140703 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:18.439475 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.wsgi [None req-18f5ecdf-e08b-463a-8484-e8b655140703 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 09 01:48:18.440146 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-18f5ecdf-e08b-463a-8484-e8b655140703 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:48:18.440982 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-18f5ecdf-e08b-463a-8484-e8b655140703 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018701 Apr 09 01:48:18.441532 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 26/52] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:48:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 09 01:48:20.016974 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:20.018086 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Apr 09 01:48:20.018516 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 27/53] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:20.207611 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-6a777a34-52bf-4b53-b161-1d1c61117d21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:48:20.232857 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-6a777a34-52bf-4b53-b161-1d1c61117d21 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.080701 Apr 09 01:48:20.233447 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 27/54] 10.222.0.38 () {64 vars in 1226 bytes} [Fri Apr 9 01:48:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:48:21.808553 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:21.809657 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Apr 09 01:48:21.810111 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 28/55] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:21.997736 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-8eb9ce5f-b1f5-47e1-a7a6-b969f72d9ee8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:48:22.021491 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-8eb9ce5f-b1f5-47e1-a7a6-b969f72d9ee8 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.080635 Apr 09 01:48:22.022004 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 28/56] 10.222.0.38 () {64 vars in 1226 bytes} [Fri Apr 9 01:48:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:48:23.592936 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:23.594021 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Apr 09 01:48:23.594468 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 29/57] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:23.779431 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-6cd29c40-b3b2-48f3-9aab-c2a5a8c719fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:48:23.803114 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-6cd29c40-b3b2-48f3-9aab-c2a5a8c719fc admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.078890 Apr 09 01:48:23.803616 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 29/58] 10.222.0.38 () {64 vars in 1226 bytes} [Fri Apr 9 01:48:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 01:48:25.375268 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:25.376449 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Apr 09 01:48:25.376902 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 30/59] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:25.563862 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-672c0075-8d08-4b59-991f-7bf960fbe7e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:48:25.588417 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-672c0075-8d08-4b59-991f-7bf960fbe7e4 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.079984 Apr 09 01:48:25.588952 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 30/60] 10.222.0.38 () {64 vars in 1226 bytes} [Fri Apr 9 01:48:25 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:48:27.169826 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:27.170920 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Apr 09 01:48:27.171391 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 31/61] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:48:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:48:27.354972 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0a47e671-4cd4-4a39-b783-80ae43756808 admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:48:27.383309 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0a47e671-4cd4-4a39-b783-80ae43756808 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082846 Apr 09 01:48:27.383893 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 31/62] 10.222.0.38 () {60 vars in 1193 bytes} [Fri Apr 9 01:48:27 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:49:19.046124 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:49:19.047205 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-0e175d2b-fde9-4887-a371-4c39089b8125 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 09 01:49:19.047644 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 32/63] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:49:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:49:19.234694 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:49:19.263013 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.084340 Apr 09 01:49:19.263501 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 32/64] 10.222.0.38 () {60 vars in 1193 bytes} [Fri Apr 9 01:49:19 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:50:52.447587 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-bce9ae7b-6214-45fd-a366-2b51976711ce tempest-verify_tempest_config-454194622 tempest-verify_tempest_config-454194622-project] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:50:52.449721 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-bce9ae7b-6214-45fd-a366-2b51976711ce tempest-verify_tempest_config-454194622 tempest-verify_tempest_config-454194622-project] 10.222.0.38 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.181411 Apr 09 01:50:52.450309 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 33/65] 10.222.0.38 () {58 vars in 1124 bytes} [Fri Apr 9 01:50:52 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:52:23.167642 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:23.168819 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Apr 09 01:52:23.169260 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 33/66] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:52:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:52:23.424342 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:23.425668 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:52:23.425668 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:52:23.427351 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:23.427856 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:23.428751 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:23.429738 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:23.462907 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-79902fd0-4abd-4341-9cc1-a626567e6fcd admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.164986 Apr 09 01:52:23.463495 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 34/67] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:52:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:52:25.058143 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:25.059223 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Apr 09 01:52:25.059670 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 34/68] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:52:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:52:25.245360 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:25.246689 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:52:25.246689 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:52:25.248327 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:25.248830 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:25.249694 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:25.250174 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:25.276071 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-3f34578f-c467-4366-941b-93cd4ab4015e admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.085963 Apr 09 01:52:25.276661 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 35/69] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:52:25 2021] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:52:37.301596 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:37.302678 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Apr 09 01:52:37.303121 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 35/70] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:52:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:52:37.486972 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:37.488324 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:52:37.488324 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:52:37.490031 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:37.490579 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:37.491414 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:37.491903 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:37.523516 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-936ca471-ceea-473a-b2ed-6de37739711f admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.092938 Apr 09 01:52:37.524573 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 36/71] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:52:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:52:39.130017 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] Calling method '>' {{(pid=84566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:39.131101 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-17f91d75-cbe3-4bfb-9a62-d1048b6363cc admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 09 01:52:39.131555 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84566|app: 0|req: 36/72] 10.222.0.38 () {56 vars in 1065 bytes} [Fri Apr 9 01:52:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:52:39.315141 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG nova.api.openstack.wsgi [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] Calling method '>' {{(pid=84565) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:52:39.316529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:52:39.316529 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: warnings.warn(msg) Apr 09 01:52:39.318178 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:39.318683 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:39.319548 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:52:39.320053 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: DEBUG oslo_concurrency.lockutils [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84565) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:52:39.349154 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: INFO nova.api.openstack.requestlog [None req-643f0720-f296-4743-959b-84a971fc7d49 admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.088485 Apr 09 01:52:39.349767 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: [pid: 84565|app: 0|req: 37/73] 10.222.0.38 () {60 vars in 1184 bytes} [Fri Apr 9 01:52:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:53:38.346355 dv-cinder-784623-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 09 01:53:38.347219 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: Fri Apr 9 01:53:38 2021 - graceful shutdown triggered... Apr 09 01:53:38.347780 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: Gracefully killing worker 1 (pid: 84565)... Apr 09 01:53:38.347952 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: Gracefully killing worker 2 (pid: 84566)... Apr 09 01:53:39.348383 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: worker 1 buried after 1 seconds Apr 09 01:53:39.348383 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: worker 2 buried after 1 seconds Apr 09 01:53:39.348383 dv-cinder-784623-6-iscsi devstack@n-api.service[84564]: goodbye to uWSGI. Apr 09 01:53:39.350350 dv-cinder-784623-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 09 01:53:39.352316 dv-cinder-784623-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 09 01:53:39.364935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Apr 9 01:53:39 2021] *** Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: nodename: dv-cinder-784623-6-iscsi Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: machine: x86_64 Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: clock source: unix Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: pcre jit disabled Apr 09 01:53:39.368178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: detected number of CPU cores: 4 Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: current working directory: / Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: detected binary path: /usr/bin/uwsgi-core Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: dropping root privileges as early as possible Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: your processes number limit is 47843 Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: your memory page size is 4096 bytes Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: detected max file descriptor number: 2048 Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: lock engine: pthread robust mutexes Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: thunder lock: enabled Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: dropping root privileges after socket binding Apr 09 01:53:39.369231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 09 01:53:39.425082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Python main interpreter initialized at 0x557d027a69c0 Apr 09 01:53:39.425082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: dropping root privileges after plugin initialization Apr 09 01:53:39.425082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: python threads support enabled Apr 09 01:53:39.425082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: your server socket listen backlog is limited to 100 connections Apr 09 01:53:39.425082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: your mercy for graceful operations on workers is 90 seconds Apr 09 01:53:39.425970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: mapped 402621 bytes (393 KB) for 2 cores Apr 09 01:53:39.425970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: *** Operational MODE: preforking *** Apr 09 01:53:39.425970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: dropping root privileges after application loading Apr 09 01:53:39.425970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: *** uWSGI is running in multiple interpreter mode *** Apr 09 01:53:39.425970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: spawned uWSGI master process (pid: 99347) Apr 09 01:53:39.426530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: spawned uWSGI worker 1 (pid: 99348, cores: 1) Apr 09 01:53:39.426035 dv-cinder-784623-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 09 01:53:39.426880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: spawned uWSGI worker 2 (pid: 99349, cores: 1) Apr 09 01:53:39.426880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 09 01:53:45.234522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 09 01:53:45.235093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 09 01:53:45.236496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 09 01:53:45.236940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 09 01:53:45.237235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 09 01:53:45.237696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.238070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.238712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.238830 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.239136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.239487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.239860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.240247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.240626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.241480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.241848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.242218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-6-iscsi {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.242595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.242948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.243303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.243669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.244028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.244544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.244731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.245352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.245698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.246052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.246412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.246776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.247331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.247690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.248090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.248445 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.248825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.249192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.249547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-6-iscsi {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.249921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.250284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.250647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.251147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.251501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.251852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.251968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 09 01:53:45.252184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 09 01:53:45.252272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.252581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.253232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.253399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.253782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 09 01:53:45.253934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.254227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 09 01:53:45.254462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.254559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 09 01:53:45.254835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.254942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.255183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.255294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.255536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.255641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.255895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.256024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.256294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.256767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.257942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.258935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784623-6-iscsi {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259736 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.259959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.260205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.260364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.260530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.260687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.260835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261445 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.261922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.262076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.262828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.262948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.263967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.264179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.264341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.264643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.264811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.264969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.265125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.265350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.265517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.265690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.265846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.266095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.266385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784623-6-iscsi {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.266501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.266756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.266866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267115 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.267980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.268304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.268529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.268898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.269939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.270085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.270241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.270902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.271849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.272996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.273322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.273475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.273629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.273792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.274622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.274745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.274860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.274860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.275926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.276989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.277123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.277342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.277456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.277708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.277822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.278887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.279875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.280058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.280217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.280364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.280567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.281286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.281446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.281600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.281757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.281906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.282822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.283302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.283469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.283622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.283768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.283921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.284984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.285923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.286918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.287063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.287224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.287378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.287524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.288265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.288431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.288675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.288836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.288998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.289145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.289145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.289145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.289567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.289712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.289712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.289995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.290142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.290295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.290454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.290629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.290793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.290945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.291096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.291241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.291399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.291544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.291695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.291840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.292001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.292164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.292319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.292465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.292610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.292770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.292914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.293083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.293561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.293717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.293870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.294021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.294167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.294325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.294564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.294717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.294862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.295013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.295168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.295325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.295471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.295618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.295769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.295769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.296155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.296403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.296555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.296702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.296847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.296993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.297144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.297311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.297457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.297612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.297758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.297958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.298122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.298276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.298428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.298573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.298815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.298975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.299133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.299286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.299441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.299586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.299738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.299883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.300057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.300209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.300366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.300511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.300662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.300808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.300808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.301099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.301259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.301412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.301564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.301721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.301880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.302038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.302183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.302328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.302484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.302637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.302782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.302933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.303078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 09 01:53:45.304129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.304309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.304464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.304711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.304872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.305930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.306958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.307930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.308150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.308306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.308467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.308612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.308764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.309900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.310965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.311862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.312031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.312193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.312457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.312620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.312778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.313794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.313955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.314373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.314531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.314696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.314696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.315853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.316897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.317956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.318892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.319612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.319612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.319920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.320894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.321926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322537 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.322991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.323143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.323294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.323440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.323590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.323590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.324013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.324329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.324612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.324781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.324943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.325926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.326854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.327881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.328888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.329931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.330863 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.331912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.332892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.333858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.334101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.334259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.334530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.335431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.335607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.335761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.335919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.336958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.337124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.337369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.337542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.337695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.337853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.338960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.339118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.339270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.339433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.339592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.339761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.340887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.341931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.342879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.343963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.344428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.344696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.344864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.345016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.345184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.345360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.345715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.345877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.346988 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.347140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.347297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.347580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.347746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.347899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.348862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.349955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.350259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.350429 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.350582 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.350734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.350893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.351946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.352920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.353975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.354134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.354398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.354911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.355926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.356966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.357909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.358948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.359999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.360108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.360361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.360707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.360822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.361068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.361188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.361418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.361590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.361767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.362980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.363925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.364147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.364308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.364554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.364723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.364900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.365137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.365295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.365446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.365598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.365772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.366897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.367065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.367065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.367361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.367635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.368060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.368229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.368395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.369520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.369706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.370748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.371543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.371716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.371895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.372116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.373342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.373516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.373672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.373832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.374908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.375071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.375344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.375515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.375668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.375833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.376279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.376448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.376602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.376762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.376921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.377870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.378867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.379947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.380909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.381221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.381901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.381901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.382924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.383844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.384212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.384385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.384385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.384697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.385824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.386119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.386119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.386636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.386796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.386954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.387883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.388957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.389910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.390861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.391957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.392948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.393698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.394084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.394564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.394732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.394891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.395042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.395295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.395482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.395722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.395899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.396129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.396287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.396528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.396807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.396974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.397675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.397834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.397985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.398136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.398317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.398553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.398717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.399032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.399189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.399302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.399389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.400474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.400589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.400589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.401927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.402617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.403824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.404925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.405170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.405298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.405536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.405719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.405864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.406019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.406232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.406334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.406634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.406766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.407938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.408078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.408322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.408434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.408689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.408809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.409870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.410927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.411169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.411282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.411530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.411641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.411912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.412213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.412333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.412722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.412883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.413979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.414244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.414349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.414631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.414774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.415894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.416998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.417252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.417379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.417595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.417702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.417946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.418052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.418304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.418409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.418681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.418850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.419943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.420997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.421102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.421350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.421455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.421705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.421816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.422948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.423113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.423512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.423796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.423909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.424247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.424365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.424620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.424725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.424988 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.425092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.425365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.425479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.425745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.425883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.426982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.427971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.428270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.428378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.428638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.428755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.428993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.429102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.429342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.429447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.429696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.429870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.430050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.430155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.430434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.430697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.430811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.431074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.431187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.431433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.431626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.431791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.432092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.432219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.432459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.432565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.432851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.433914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.434970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.435056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.435353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.435455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.435676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.435773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.436853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.437980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.438179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.438330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.438547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.438675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.438906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.439975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.440160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.440355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.440525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.440709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.440874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.441823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.442088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.442195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.442441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.442557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.442811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.443091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.443200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.443301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.443504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.443617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.444494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.444628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.444770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.444884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.445144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.445368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.445487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.445729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.445836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.446971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.447341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.447463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.447578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.447682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.447894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.448965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.449078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.449314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.449427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.449663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.449776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.450827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.451079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.451192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.451425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.451533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.451781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452831 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.452939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.453173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.453324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.453551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.453658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.453913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.454965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.455084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.455313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.455420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.455673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.455785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.456853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.457912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.458972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.459197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.459510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.460290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.460451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.460589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.460809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.460927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.461963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.462203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.462311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.462558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.462673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.462898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.463952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.464143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.464326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.464434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.464689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.464835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.465858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466817 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.466923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.467191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.467297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.467551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.467663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.467908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.468097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.468335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.468460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.468704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.468821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.469061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.469309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.469416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.469692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.469793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.470916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.471968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.472250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.472357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.472607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.472718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.472964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.473107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.473322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.473428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.473680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.473807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.474033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.474267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.474384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.474632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.474755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.475858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.476986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.477226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.477341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.477578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.477683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.477933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.478971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.479079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.479331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.479440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.479930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.480064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.480325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.480433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.480666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.480765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.481985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.482243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.482357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.482596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.482709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.482974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.483088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.483440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.483561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.483734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.483880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.484926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.485153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.485259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.485497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.485603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.485886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.486005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.486274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.486638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.486745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.487868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.488961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.489191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.489319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.489543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.489652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.489900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.490996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.491201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.491355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.491560 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.491719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.491925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.492090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.492308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.492425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.492670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.492776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.493877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.494942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.495175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.495290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.495526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.495633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.495889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.496992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.497098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.497356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.497470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.497707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.497844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.498064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.498171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.498420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.498690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.498804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.499085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.499250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.499464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.499723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.499866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.500964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.501221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.501362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.501591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.501706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.501951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.502073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.502313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.502435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.502688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.502800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.503877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.504967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.505201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.505314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.505573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.505679 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.505940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.506054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.506308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.506917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.507216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.507393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.507576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.507683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.507940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.508061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.508329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.508437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.508626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99349) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 09 01:53:45.508739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.509021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.509391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.509778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.510145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.510499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.510998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.511361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.511730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.512124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.512484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.512869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.513267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.513654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.514051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.514407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.514760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.515112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.515470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.515873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.516302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.516674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.517049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.517433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.517799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.518160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.518524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.518886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.519248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.519621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.520026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.520385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.520748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.521124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.521483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.521856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.522752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.523116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.523478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.523841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.524256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.524622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.524999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.525362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.525742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.526100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.526476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.526852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.527223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.527581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.527979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.528425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.528724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.529083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.529465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.529809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.530163 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.530837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.531225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.531812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.531918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.532315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.532692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.533058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.533420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.533805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.534166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.534534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.534894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.535255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.535620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.536005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.536387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.536766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.537144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.537522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.537960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.538331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.538737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.539121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 09 01:53:45.539408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99348) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 09 01:53:45.544350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99349) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.575742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99348) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.806026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.context [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1fd6123a-d6c7-4733-89a5-8079297c7441(cell1) {{(pid=99349) load_cells /opt/stack/nova/nova/context.py:466}} Apr 09 01:53:45.812079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:53:45.814012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:53:45.814954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:53:45.817175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:53:45.842970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99349) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.843743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.context [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1fd6123a-d6c7-4733-89a5-8079297c7441(cell1) {{(pid=99348) load_cells /opt/stack/nova/nova/context.py:466}} Apr 09 01:53:45.844369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99349) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.849526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:53:45.851441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:53:45.852338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:53:45.854731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:53:45.880590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99349) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.892451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99348) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.893553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99348) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.925666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99348) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 09 01:53:45.968941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:53:45.968941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: from cryptography.utils import int_from_bytes Apr 09 01:53:45.969501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:53:45.969501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: from cryptography.utils import int_from_bytes Apr 09 01:53:46.009847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:53:46.009847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: from cryptography.utils import int_from_bytes Apr 09 01:53:46.010266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 09 01:53:46.010266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: from cryptography.utils import int_from_bytes Apr 09 01:53:46.048708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading Gnome Apr 09 01:53:46.070719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading Google Apr 09 01:53:46.074183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading Windows (alt) Apr 09 01:53:46.078962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading file Apr 09 01:53:46.080832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading keyczar Apr 09 01:53:46.081298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading multi Apr 09 01:53:46.082195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Loading pyfs Apr 09 01:53:46.087575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading Gnome Apr 09 01:53:46.109601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading Google Apr 09 01:53:46.113038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading Windows (alt) Apr 09 01:53:46.118351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading file Apr 09 01:53:46.120192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading keyczar Apr 09 01:53:46.120872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading multi Apr 09 01:53:46.121662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO keyring.backend [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Loading pyfs Apr 09 01:53:46.470015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:53:46.477305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:53:46.505121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:53:46.512901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:53:46.716484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:53:46.722490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-1510523e-6715-45b8-8830-d1ffb48b9d96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:53:46.728612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557d027a69c0 pid: 99349 (default app) Apr 09 01:53:46.746653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 09 01:53:46.752689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WARNING keystonemiddleware.auth_token [None req-e43a6c71-03c3-455d-b295-11be24fa227a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 09 01:53:46.758906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557d027a69c0 pid: 99348 (default app) Apr 09 01:54:24.778728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-46cfe2b1-6d94-436c-aecb-f7d3eb343363 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Action: 'create', calling method: .version_select at 0x7f966e76d048>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-258544255", "metadata": {"Type": "work"}}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:27.496482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1474932348", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "31dea640-a55c-4934-8416-2f6053542187"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:28.492111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] validate_networks() for [('31dea640-a55c-4934-8416-2f6053542187', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:54:28.559606 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-46cfe2b1-6d94-436c-aecb-f7d3eb343363 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.385493 Apr 09 01:54:28.560340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 1/1] 10.222.0.38 () {60 vars in 1146 bytes} [Fri Apr 9 01:54:23 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 5388 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 09 01:54:28.574164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-637a87ed-62af-4fc7-9a83-8f852cc0d9a0 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966e76d8c8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:28.717456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-637a87ed-62af-4fc7-9a83-8f852cc0d9a0 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/3541930d-a675-4c4a-a437-48c5984a71dd" status: 200 len: 351 microversion: 2.1 time: 0.155805 Apr 09 01:54:28.719942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 2/2] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:28 2021] GET /compute/v2.1/os-volumes/3541930d-a675-4c4a-a437-48c5984a71dd => generated 351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:28.727060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e6e4ad46-6d4a-443c-973b-c7912633daed tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Calling method '.version_select at 0x7f966e840a60>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:29.388964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e6e4ad46-6d4a-443c-973b-c7912633daed tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4" status: 200 len: 353 microversion: 2.1 time: 0.667130 Apr 09 01:54:29.389574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 3/3] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:28 2021] GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4 => generated 353 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:29.401920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-028d59d1-9ee1-4d6c-84ab-99da121c8a93 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Calling method '.version_select at 0x7f966e840e18>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:29.738967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-028d59d1-9ee1-4d6c-84ab-99da121c8a93 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4" status: 200 len: 353 microversion: 2.1 time: 0.340718 Apr 09 01:54:29.740751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 4/4] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:29 2021] GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4 => generated 353 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:29.858556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1812716093", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "107997fa-4577-421c-97e5-52be9579a476"}]}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:30.074438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] validate_networks() for [('107997fa-4577-421c-97e5-52be9579a476', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:54:31.053484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:54:31.054538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:54:31.055270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:54:31.055875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:54:31.056528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:54:31.078952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:31.079738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:31.080842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:31.081484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:31.143089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Getting quotas for project 16a02a873b584bde83597c4fb075430a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:54:31.149066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Getting quotas for user 6012e110fad3489dbc3e16b865523ee1 and project 16a02a873b584bde83597c4fb075430a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:54:31.186663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:54:31.194763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:54:31.406897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2e443bfc-97a6-4a0e-9360-58c20cb00416 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.266287 Apr 09 01:54:31.409479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 1/5] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:54:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 5271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:54:31.423403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2003c3a5-50e7-4b91-8f99-573e520bfe6b tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Calling method '.version_select at 0x7f966e827a60>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:31.777510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2003c3a5-50e7-4b91-8f99-573e520bfe6b tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4" status: 202 len: 0 microversion: 2.1 time: 0.365093 Apr 09 01:54:31.778697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 2/6] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 01:54:31 2021] DELETE /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:54:31.791936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-78b9bb81-3e0a-40c0-9ad4-7dbeb2eea881 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966e7d10d0>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:32.341139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-78b9bb81-3e0a-40c0-9ad4-7dbeb2eea881 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/862c90c9-531e-4e38-a7a4-ae1ad2ebc3b5" status: 200 len: 350 microversion: 2.1 time: 0.559870 Apr 09 01:54:32.350038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 3/7] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:31 2021] GET /compute/v2.1/os-volumes/862c90c9-531e-4e38-a7a4-ae1ad2ebc3b5 => generated 350 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:32.381516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2960c3cb-0599-4afb-a50d-7b53547f1760 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:32.382332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2960c3cb-0599-4afb-a50d-7b53547f1760 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:32.835303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2960c3cb-0599-4afb-a50d-7b53547f1760 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:32.857350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2960c3cb-0599-4afb-a50d-7b53547f1760 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1215 microversion: 2.1 time: 0.492117 Apr 09 01:54:32.857981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 4/8] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:32 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1215 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:32.883971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1bc62532-4ce5-46f5-91e2-46b390234d51 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Calling method '.version_select at 0x7f966dee3620>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:33.078491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-1bc62532-4ce5-46f5-91e2-46b390234d51 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] HTTP exception thrown: Volume 798d74e0-0120-4505-bc7c-815cfc5ff9e4 could not be found. Apr 09 01:54:33.079693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1bc62532-4ce5-46f5-91e2-46b390234d51 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] Returning 404 to user: Volume 798d74e0-0120-4505-bc7c-815cfc5ff9e4 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:54:33.082084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1bc62532-4ce5-46f5-91e2-46b390234d51 tempest-VolumesGetTestJSON-1243431632 tempest-VolumesGetTestJSON-1243431632-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4" status: 404 len: 109 microversion: 2.1 time: 0.201922 Apr 09 01:54:33.093193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 5/9] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:32 2021] GET /compute/v2.1/os-volumes/798d74e0-0120-4505-bc7c-815cfc5ff9e4 => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:54:33.564634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:54:33.565743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:54:33.566484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:54:33.567382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:54:33.568778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:54:33.606979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:33.607558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:33.608541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:33.609032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:33.694556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:54:33.732744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for user 957d5db34f84437bbb972ed0ea8d8ae5 and project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:54:33.791425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:54:33.804727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:54:33.888139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:33.890406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:33.931298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:33.932169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:33.933653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:33.934485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:34.118446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1f9eacf8-f4f7-4f73-99f5-815444783618 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.376175 Apr 09 01:54:34.119274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 5/10] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:54:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 4378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:54:34.137815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6c6fa91f-41be-47c9-8454-598ef01913dc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:34.138464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6c6fa91f-41be-47c9-8454-598ef01913dc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:34.795503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6c6fa91f-41be-47c9-8454-598ef01913dc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:34.816335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6c6fa91f-41be-47c9-8454-598ef01913dc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1218 microversion: 2.1 time: 0.683599 Apr 09 01:54:34.828143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 6/11] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:34 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1218 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:35.174106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:35.273799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8dcf0628-99a6-40d3-98fd-67abf32642f7 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1219 microversion: 2.1 time: 1.400809 Apr 09 01:54:35.300600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 6/12] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:33 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1219 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:35.865905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5dfe534-7522-4530-97f6-c0e86b10c821 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:35.867824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5dfe534-7522-4530-97f6-c0e86b10c821 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:36.321787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:36.333221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:36.366055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:36.372815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:36.374626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:36.375625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:36.616511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5dfe534-7522-4530-97f6-c0e86b10c821 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:36.632543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5dfe534-7522-4530-97f6-c0e86b10c821 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1218 microversion: 2.1 time: 0.772106 Apr 09 01:54:36.635345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 7/13] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:35 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1218 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:36.847069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:36.862179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2ae27a14-09e6-43e5-9782-be9436c4861c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1211 microversion: 2.1 time: 0.549837 Apr 09 01:54:36.862840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 7/14] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:36 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1211 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:37.665333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:37.666548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:37.709001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:37.712911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:37.716665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:37.719235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:37.904549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:37.908729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:37.949701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:37.959653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:37.960788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:37.965573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:38.384124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:38.443149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-78c9ab70-f583-4809-8c5a-7595033b82de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1214 microversion: 2.1 time: 0.780139 Apr 09 01:54:38.444306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 8/15] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:37 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1214 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:38.484618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-800d7bee-04eb-42f1-9ca4-076bc11b6cdc tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966e6f7f28>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:38.668188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:38.757942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2c4c63d1-c7f9-40df-8d24-678177dbf865 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1275 microversion: 2.1 time: 0.862863 Apr 09 01:54:38.763903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 8/16] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:37 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1275 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:39.096352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-800d7bee-04eb-42f1-9ca4-076bc11b6cdc tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/8f936d7a-6613-4046-8e39-5e526f866414" status: 200 len: 350 microversion: 2.1 time: 0.649627 Apr 09 01:54:39.097745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 9/17] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:54:38 2021] GET /compute/v2.1/os-volumes/8f936d7a-6613-4046-8e39-5e526f866414 => generated 350 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:39.130568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b37259de-e1ad-427d-83a0-001e30cc4d7c tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966de77ea0>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:39.391541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b37259de-e1ad-427d-83a0-001e30cc4d7c tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.268083 Apr 09 01:54:39.392966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 9/18] 10.222.0.38 () {58 vars in 1124 bytes} [Fri Apr 9 01:54:39 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:39.412426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-272e86b1-af82-4a49-b478-c4883e8131c2 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966de09c80>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:39.481129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:39.482319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:39.569724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:39.572696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:39.574377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:39.580754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:39.764848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-272e86b1-af82-4a49-b478-c4883e8131c2 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.361651 Apr 09 01:54:39.765935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 10/19] 10.222.0.38 () {58 vars in 1139 bytes} [Fri Apr 9 01:54:39 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:39.817493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-27281da3-f434-4af3-aacb-b7241fc99b5b tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966de1e8c8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:40.123822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:40.140791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f0a3f691-fa17-4139-8297-7a35b92f9a8e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1276 microversion: 2.1 time: 0.668891 Apr 09 01:54:40.145596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 10/20] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:39 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1276 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:40.159681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:40.160651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:40.181574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:40.185980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:40.188695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:40.192814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:40.202188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-27281da3-f434-4af3-aacb-b7241fc99b5b tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.423647 Apr 09 01:54:40.203223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 11/21] 10.222.0.38 () {58 vars in 1124 bytes} [Fri Apr 9 01:54:39 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:40.216390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d9a75194-1344-4553-984a-333029cbf944 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966de1eb70>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:40.679020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:40.695300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6c12401e-d2c7-4ab7-bb27-64c981e6765e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1273 microversion: 2.1 time: 0.545771 Apr 09 01:54:40.696426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 11/22] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:40 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1273 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:40.830008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d9a75194-1344-4553-984a-333029cbf944 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.617352 Apr 09 01:54:40.831638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 12/23] 10.222.0.38 () {58 vars in 1157 bytes} [Fri Apr 9 01:54:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:54:40.845002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-799608b9-5f60-4ce8-9c20-464f38ac7de0 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966de77a60>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:41.180161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:41.181433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:41.214327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:41.221059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:41.229910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:41.231941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:41.295321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-799608b9-5f60-4ce8-9c20-464f38ac7de0 tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.454435 Apr 09 01:54:41.296396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 12/24] 10.222.0.38 () {58 vars in 1160 bytes} [Fri Apr 9 01:54:40 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:41.312953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4413d66d-d0f2-4877-af86-7e8f4f4afadc tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966ddf8ae8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:41.556971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4413d66d-d0f2-4877-af86-7e8f4f4afadc tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.250133 Apr 09 01:54:41.557609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 13/25] 10.222.0.38 () {58 vars in 1145 bytes} [Fri Apr 9 01:54:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:41.571933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a819ad49-8451-4199-ac70-c68469de9c5c tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966ddf8840>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:41.787364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a819ad49-8451-4199-ac70-c68469de9c5c tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.220602 Apr 09 01:54:41.788018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 14/26] 10.222.0.38 () {58 vars in 1178 bytes} [Fri Apr 9 01:54:41 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:41.804672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:41.805919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:41.816121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:41.819684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:41.821164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:41.821888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:41.939815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:41.982178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f72aaef5-55a0-4642-8ae5-43bebb08d8b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1276 microversion: 2.1 time: 0.806781 Apr 09 01:54:41.985539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 13/27] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:41 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1276 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:41.991584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bcc67bd9-ba1d-4e4a-8cb7-b51e5aef18ad tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] Calling method '.version_select at 0x7f966e6f7f28>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:42.318674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bcc67bd9-ba1d-4e4a-8cb7-b51e5aef18ad tempest-VolumesTestJSON-1226952353 tempest-VolumesTestJSON-1226952353-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.330868 Apr 09 01:54:42.319716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 14/28] 10.222.0.38 () {58 vars in 1145 bytes} [Fri Apr 9 01:54:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:42.612574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:42.673684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a178f8ad-2b65-4505-8abe-800de5777396 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1273 microversion: 2.1 time: 0.875146 Apr 09 01:54:42.687151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 15/29] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:41 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1273 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:43.016897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:43.018022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:43.092289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:43.093539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:43.096612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:43.104008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:43.719076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:43.720062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:43.746626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:43.748351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:43.761190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:43.761962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:44.089967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:44.114998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-60677d7a-4967-444a-a058-03634a9df617 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1273 microversion: 2.1 time: 0.400176 Apr 09 01:54:44.115705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 16/30] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:43 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1273 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:44.356520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:44.380637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0e21e150-dbb8-48c3-b4dd-849fa2c80097 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 1.362312 Apr 09 01:54:44.381491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 15/31] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:43 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:45.137873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:45.143466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:45.189207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:45.197344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:45.204217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:45.205515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:45.401729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:45.402753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:45.430888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:45.433107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:45.456050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:45.461229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:46.515017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:46.550424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c77fc862-bacc-40a4-9818-2dd5b92d26f4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1273 microversion: 2.1 time: 1.420897 Apr 09 01:54:46.576056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 17/32] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:45 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1273 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:47.192045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:47.238101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b32a3a99-e753-450d-a45f-c0310f12568d tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 1.836988 Apr 09 01:54:47.242078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 16/33] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:45 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:47.593115 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:47.596669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:47.644972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:47.650524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:47.654701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:47.655739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:48.266989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:48.268447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:48.292341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:48.293083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:48.295461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:48.297011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:48.388440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:48.411905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-08e85791-ae8a-4b6f-853d-2adc88ebb32a tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1273 microversion: 2.1 time: 0.829913 Apr 09 01:54:48.413222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 18/34] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:47 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1273 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:49.449264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:49.449942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:49.481293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:49.481840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:49.482744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:49.483234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:49.486776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:49.502546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-04c713f1-0d82-4702-a393-6b3e390c750b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 1.248985 Apr 09 01:54:49.503508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 17/35] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:48 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:50.545693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:50.548048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:50.594818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:50.596224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:50.598087 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:50.599915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:52.122423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:52.149603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c90aac60-7c27-4d94-8ddd-a6e369311a72 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 2.689985 Apr 09 01:54:52.150311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 19/36] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:49 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:52.548271 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-4e009070-454c-4677-a34d-3f8bb2b56652 req-de5e9d8f-2081-42e3-9176-0e8a0de72501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8dfd3c-580f-4c46-a9ee-300b305ca1d1", "tag": "8d9b252f-f22d-4ce9-b735-5bd12865a4da"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:52.551148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:54:52.551148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:54:52.574839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4e009070-454c-4677-a34d-3f8bb2b56652 req-de5e9d8f-2081-42e3-9176-0e8a0de72501 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:52.578221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4e009070-454c-4677-a34d-3f8bb2b56652 req-de5e9d8f-2081-42e3-9176-0e8a0de72501 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:52.657841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-4e009070-454c-4677-a34d-3f8bb2b56652 req-de5e9d8f-2081-42e3-9176-0e8a0de72501 service nova] Creating event network-changed:8d9b252f-f22d-4ce9-b735-5bd12865a4da for instance 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 on hv-cinder-78462 Apr 09 01:54:52.658413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4e009070-454c-4677-a34d-3f8bb2b56652 req-de5e9d8f-2081-42e3-9176-0e8a0de72501 service nova] Acquired lock "compute-rpcapi-router" {{(pid=99348) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 09 01:54:52.660379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:52.660379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:52.661940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:52.662435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:52.706961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.compute.rpcapi [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 09 01:54:52.710801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] Releasing lock "compute-rpcapi-router" {{(pid=99348) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 09 01:54:52.791525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7a8ee69d-3f6c-4f57-8cde-b1244f0a0650 None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.639228 Apr 09 01:54:52.792611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 20/37] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:54:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:54:52.958851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:53.008102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96eedae5-f66b-4078-8b2c-e935f9e2ea00 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 2.473900 Apr 09 01:54:53.010654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 18/38] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:50 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:53.170699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:53.171495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:53.194666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:53.195151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:53.205954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:53.208745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:54.031223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:54.032320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:54.065109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:54.067079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:54.072374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:54.075016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:56.202105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:56.214808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eaf5f600-b702-4a99-86c7-80fa6918ca5e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 3.049386 Apr 09 01:54:56.218507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 21/39] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:53 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 3054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:56.374588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:54:56.398348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1ba89dee-738a-4ee0-8c6b-8b2ce4867563 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 2.373552 Apr 09 01:54:56.411616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 19/40] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:54 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:54:57.005578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: .version_select at 0x7f966de2fd90>, body: {"keypair": {"name": "tempest-keypair-2110122593"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:57.102440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1560238609", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b134a394-11b9-4c54-bed1-cfe6d0f309b1"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:54:57.146926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:54:57.163755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:54:57.419254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] validate_networks() for [('b134a394-11b9-4c54-bed1-cfe6d0f309b1', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:54:58.618525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:54:58.647772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:54:58.738951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42823553-9baa-44cb-9e74-44f859d5a9e6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 2.214029 Apr 09 01:54:58.750470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 20/41] 10.222.0.38 () {60 vars in 1148 bytes} [Fri Apr 9 01:54:56 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:54:58.776033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:54:58.781568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:54:58.858359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:58.859613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:54:58.861099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:54:58.882680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:00.857852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:55:00.858744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:55:00.859850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:55:00.860803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:55:00.868244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:55:00.934738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:00.936512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:00.937476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:00.939491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:00.962501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-85ca55f2-e740-40f0-b8a3-ed5085382136 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 2.210320 Apr 09 01:55:00.963363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:00.987064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 21/42] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:54:58 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:00.992508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:00.998961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:01.023764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:01.024410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:01.027620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:01.035137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:01.082315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Getting quotas for project 96703e956e034c16ad1cca21be36101a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:55:01.110734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Getting quotas for user b15ae24f513f44e58bc13beedc4ead83 and project 96703e956e034c16ad1cca21be36101a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:55:01.171628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:55:01.187874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:55:01.394659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:01.406943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4eb9cbdc-9fef-4f25-9d57-98656008920b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 0.419142 Apr 09 01:55:01.407861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 22/43] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:00 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:01.522384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-34317fac-6a88-4edc-be71-13f62bf42707 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.301750 Apr 09 01:55:01.523370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 22/44] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:54:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 5304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:55:01.539652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d8487b5a-2906-42b9-80b0-e87f15c8e347 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:01.540359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d8487b5a-2906-42b9-80b0-e87f15c8e347 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:01.797509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8487b5a-2906-42b9-80b0-e87f15c8e347 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:01.809932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d8487b5a-2906-42b9-80b0-e87f15c8e347 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1222 microversion: 2.1 time: 0.275140 Apr 09 01:55:01.812295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 23/45] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:01 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:01.991751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:01.993776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:02.026873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:02.031932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:02.040946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:02.050061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:02.859607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:02.914869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-99fd050a-ce0c-4e29-95ea-32b605412233 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 0.913799 Apr 09 01:55:02.916721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 23/46] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:01 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:02.955624 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:02.958648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:03.000472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:03.001832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:03.003155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:03.005227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:03.269991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-b2f01dd2-8706-4b17-8ded-c842b445d49d req-2368674d-01ef-40d2-81d1-d9a8ee889014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2d1156-bc2a-4483-890b-4b6383145eed", "tag": "91b21ad2-0b7d-445a-9838-3744612d05b9"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:03.277792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:03.277792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:03.312164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b2f01dd2-8706-4b17-8ded-c842b445d49d req-2368674d-01ef-40d2-81d1-d9a8ee889014 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:03.314334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b2f01dd2-8706-4b17-8ded-c842b445d49d req-2368674d-01ef-40d2-81d1-d9a8ee889014 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:03.396565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-b2f01dd2-8706-4b17-8ded-c842b445d49d req-2368674d-01ef-40d2-81d1-d9a8ee889014 service nova] Creating event network-changed:91b21ad2-0b7d-445a-9838-3744612d05b9 for instance ca2d1156-bc2a-4483-890b-4b6383145eed on hv-cinder-78462 Apr 09 01:55:03.397367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b2f01dd2-8706-4b17-8ded-c842b445d49d req-2368674d-01ef-40d2-81d1-d9a8ee889014 service nova] Acquired lock "compute-rpcapi-router" {{(pid=99349) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 09 01:55:03.399060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:03.411655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:03.416305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:03.422628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:03.450632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.compute.rpcapi [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 09 01:55:03.452244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] Releasing lock "compute-rpcapi-router" {{(pid=99349) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 09 01:55:03.503962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:03.520067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1c2648f1-c212-46e0-9a2f-624369d91bb1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 0.588815 Apr 09 01:55:03.525645 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 24/47] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:02 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:03.532307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e5a61442-7bc9-4fcd-b373-35d63fd279ca None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.431122 Apr 09 01:55:03.533941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 24/48] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:55:03.537679 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921553135", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b134a394-11b9-4c54-bed1-cfe6d0f309b1"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:03.690404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] validate_networks() for [('b134a394-11b9-4c54-bed1-cfe6d0f309b1', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:55:03.994539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:04.008315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:04.072219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:04.096387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:04.099851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:04.104135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:05.733929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:05.750066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-37b340dd-fcb8-4339-8e9a-09f511c8047d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 1.807451 Apr 09 01:55:05.753050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 25/49] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:03 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:05.762301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:05.768916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:05.788227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:05.798053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:05.799590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:05.800361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:06.111516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:55:06.112499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:55:06.113731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:55:06.115191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:55:06.117888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:55:06.186655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:06.187522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:06.195740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:06.201344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:06.298201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Getting quotas for project 96703e956e034c16ad1cca21be36101a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:55:06.316533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Getting quotas for user b15ae24f513f44e58bc13beedc4ead83 and project 96703e956e034c16ad1cca21be36101a. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:55:06.379907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:55:06.390770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:55:06.635364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-767bbb85-b447-4ab6-9f16-42f099629d45 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.102084 Apr 09 01:55:06.637080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 25/50] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:55:03 2021] POST /compute/v2.1/servers => generated 383 bytes in 3115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:55:06.672711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d367156a-a535-480f-811c-22e7abd35d3e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:06.673894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d367156a-a535-480f-811c-22e7abd35d3e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:07.383596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d367156a-a535-480f-811c-22e7abd35d3e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:07.414059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d367156a-a535-480f-811c-22e7abd35d3e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1221 microversion: 2.1 time: 0.752891 Apr 09 01:55:07.415139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 26/51] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:06 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1221 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:07.430202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:07.430927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:07.468531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:07.469055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:07.470281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:07.470977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:08.215368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:08.241565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bab350a4-82ea-43f1-81a4-aa403535ea02 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 2.483662 Apr 09 01:55:08.242605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 26/52] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:05 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:08.716158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-4a5afb38-a50b-4405-9743-a39917796905 req-63e9f8b2-9556-449d-9736-d8f52c8df70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8dfd3c-580f-4c46-a9ee-300b305ca1d1", "name": "network-vif-plugged", "status": "completed", "tag": "8d9b252f-f22d-4ce9-b735-5bd12865a4da"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:08.719469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:08.719469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:08.738619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4a5afb38-a50b-4405-9743-a39917796905 req-63e9f8b2-9556-449d-9736-d8f52c8df70f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:08.740047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4a5afb38-a50b-4405-9743-a39917796905 req-63e9f8b2-9556-449d-9736-d8f52c8df70f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:08.767500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-4a5afb38-a50b-4405-9743-a39917796905 req-63e9f8b2-9556-449d-9736-d8f52c8df70f service nova] Creating event network-vif-plugged:8d9b252f-f22d-4ce9-b735-5bd12865a4da for instance 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 on hv-cinder-78462 Apr 09 01:55:08.782648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-4a5afb38-a50b-4405-9743-a39917796905 req-63e9f8b2-9556-449d-9736-d8f52c8df70f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537779 Apr 09 01:55:08.783540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 27/53] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:08.790614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:08.792114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:08.802790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:08.803527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:08.804725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:08.805492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:08.971125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:08.985546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e9c1b1a9-cbc1-4e40-b32b-899b65fdc2d4 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 1.569189 Apr 09 01:55:08.986200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 27/54] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:07 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:09.279483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:09.280757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:09.343888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:09.344720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:09.348344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:09.351077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:11.259022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:11.274310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8347139c-37f2-4bb2-8118-3fbfa394a1c0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 2.003442 Apr 09 01:55:11.275283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 28/55] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:09 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:11.281626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:11.282646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:11.294331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:11.294942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:11.296178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:11.296800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:12.328888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:12.353457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d7eb2ef4-d6c6-4d41-b8f7-4cf5526c7c76 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 1.076158 Apr 09 01:55:12.354962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 29/56] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:11 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:12.377063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-7150a5f3-2934-4779-98f3-deb5a62efe24 req-307ef785-07a4-477f-8b72-7f3a2016c81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2d1156-bc2a-4483-890b-4b6383145eed", "name": "network-vif-plugged", "status": "completed", "tag": "91b21ad2-0b7d-445a-9838-3744612d05b9"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:12.384412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:12.384412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:12.410342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-7150a5f3-2934-4779-98f3-deb5a62efe24 req-307ef785-07a4-477f-8b72-7f3a2016c81e service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:12.412906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-7150a5f3-2934-4779-98f3-deb5a62efe24 req-307ef785-07a4-477f-8b72-7f3a2016c81e service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:12.464206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-7150a5f3-2934-4779-98f3-deb5a62efe24 req-307ef785-07a4-477f-8b72-7f3a2016c81e service nova] Creating event network-vif-plugged:91b21ad2-0b7d-445a-9838-3744612d05b9 for instance ca2d1156-bc2a-4483-890b-4b6383145eed on hv-cinder-78462 Apr 09 01:55:12.477072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-7150a5f3-2934-4779-98f3-deb5a62efe24 req-307ef785-07a4-477f-8b72-7f3a2016c81e service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117693 Apr 09 01:55:12.478548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 30/57] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:12.491892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:12.494218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:12.538413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:12.540374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:12.542225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:12.543616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:13.294931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:13.328477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-813164f3-f327-42ea-96ad-ab2f37c24225 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1217 microversion: 2.1 time: 4.542699 Apr 09 01:55:13.334531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 28/58] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:08 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1217 bytes in 4550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:13.388569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:13.394122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:13.433978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:13.440589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:13.446921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:13.449100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:14.785205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:14.831014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2a81d510-6025-4ec1-a711-918df77848e9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1318 microversion: 2.1 time: 2.347777 Apr 09 01:55:14.874226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 31/59] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:12 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1318 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:14.899504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-939219253", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14cb7a3-6ad5-45e4-b2a1-6f9d83bedcb3"}], "security_groups": [{"name": "tempest-securitygroup--539316028"}], "key_name": "tempest-keypair-2110122593", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:15.122240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:15.153991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ec496077-282d-4b89-923c-3793cb34e786 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1315 microversion: 2.1 time: 1.774936 Apr 09 01:55:15.154655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 29/60] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:13 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1315 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:15.174432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:15.175368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:15.188896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:15.189754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:15.190946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:15.191599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:15.333008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] validate_networks() for [('b14cb7a3-6ad5-45e4-b2a1-6f9d83bedcb3', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:55:16.224309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:16.254509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e9086e49-fcba-4534-b2db-8e753754c33f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 1.084849 Apr 09 01:55:16.260076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 30/61] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:15 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:16.283088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-cca1a053-08dd-43bd-8f60-990e6d6d5c8b req-e05313bd-0aeb-43ab-b0ec-8675e4604582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47fda47-7dce-41c1-a042-ebcab29da95d", "tag": "49e02430-bf03-47db-9526-5f7dbe52b57b"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:16.298543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:16.298543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:16.340717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-cca1a053-08dd-43bd-8f60-990e6d6d5c8b req-e05313bd-0aeb-43ab-b0ec-8675e4604582 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:16.341342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-cca1a053-08dd-43bd-8f60-990e6d6d5c8b req-e05313bd-0aeb-43ab-b0ec-8675e4604582 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:16.414984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-cca1a053-08dd-43bd-8f60-990e6d6d5c8b req-e05313bd-0aeb-43ab-b0ec-8675e4604582 service nova] Creating event network-changed:49e02430-bf03-47db-9526-5f7dbe52b57b for instance e47fda47-7dce-41c1-a042-ebcab29da95d on hv-cinder-78462 Apr 09 01:55:16.433523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-cca1a053-08dd-43bd-8f60-990e6d6d5c8b req-e05313bd-0aeb-43ab-b0ec-8675e4604582 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171131 Apr 09 01:55:16.442902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 31/62] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:16.456623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:16.459341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:16.504411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:16.505966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:16.507590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:16.508532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:17.848810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:55:17.849883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:55:17.850694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:55:17.851305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:55:17.852008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:55:17.865191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:17.873656 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:17.874920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:17.877291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:17.946591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:55:17.954155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:55:17.987122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:55:17.996571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:55:18.068378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:18.078663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5f45be9c-a7ce-4c8e-bff9-b195e8f32ae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.201977 Apr 09 01:55:18.081781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 32/63] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:55:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:55:18.084444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-349579d6-0413-4c92-b214-1d63cdc82162 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1509 microversion: 2.1 time: 1.643444 Apr 09 01:55:18.087148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 32/64] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:16 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1509 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:18.096283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:18.097411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:18.105179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:18.106416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:18.133283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:18.134086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:18.135695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:18.142092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:18.149428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:18.152947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:18.155124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:18.157533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:19.785581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:19.797828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-56ffe3e9-8803-498e-bcbe-dae4e33fcabe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 1.709033 Apr 09 01:55:19.807783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:19.811848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 33/65] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:18 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:19.816218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f10fde6f-504d-4566-96f9-fd22a4645ea1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1501 microversion: 2.1 time: 1.730282 Apr 09 01:55:19.817397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 33/66] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:18 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1501 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:19.823859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-fcc0294d-9b71-4970-ae42-85d4fd3083c4 req-f5080f40-3952-41ee-b280-0cf0c980c5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4de4dd-c73a-4ea9-8271-bc81f850217c", "tag": "09ce87aa-c7ef-40b2-84ee-1f1b872471fe"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:19.828780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:19.828780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:19.833915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:19.835541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:19.848547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fcc0294d-9b71-4970-ae42-85d4fd3083c4 req-f5080f40-3952-41ee-b280-0cf0c980c5dd service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:19.852448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:19.853247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fcc0294d-9b71-4970-ae42-85d4fd3083c4 req-f5080f40-3952-41ee-b280-0cf0c980c5dd service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:19.856689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:19.861094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:19.861797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:19.902268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-fcc0294d-9b71-4970-ae42-85d4fd3083c4 req-f5080f40-3952-41ee-b280-0cf0c980c5dd service nova] Creating event network-changed:09ce87aa-c7ef-40b2-84ee-1f1b872471fe for instance 6b4de4dd-c73a-4ea9-8271-bc81f850217c on hv-cinder-78462 Apr 09 01:55:19.908431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-fcc0294d-9b71-4970-ae42-85d4fd3083c4 req-f5080f40-3952-41ee-b280-0cf0c980c5dd service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095035 Apr 09 01:55:19.909237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 34/67] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:20.035787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:20.046338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-65886902-bcf0-4d76-9793-a795b3d8d1b5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1289 microversion: 2.1 time: 0.227822 Apr 09 01:55:20.056850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 34/68] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:19 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1289 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:20.817232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:20.817998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:20.837297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:20.837726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:20.838599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:20.839093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:21.006843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3459ef94-77f4-4e72-a996-5a722c3f8efd"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:21.008252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:21.055749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:21.056361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:21.060868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:21.063119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:22.146046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:22.205763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a58c876c-402d-4ac1-8f67-8d43599dc2d8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 1.383080 Apr 09 01:55:22.228361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 35/69] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:20 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:22.243646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:22.245540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:22.264880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:22.266273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:22.268130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:22.269253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:22.639351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:22.693328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-00fc39ec-afc5-4ba0-ac18-98b8ab2a4491 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1295 microversion: 2.1 time: 0.461892 Apr 09 01:55:22.709183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 36/70] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:22 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1295 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:23.052130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-02f2f207-cad4-41a8-9b73-60f0e940a4e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.050878 Apr 09 01:55:23.060820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 35/71] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:55:20 2021] POST /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1/os-volume_attachments => generated 194 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:23.242434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:23.248635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:23.302940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:23.311795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:23.321720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:23.325393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:23.743716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:23.753801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:23.791199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:23.791709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:23.792621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:23.793090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:24.007793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:24.080247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a26ba134-a7a7-49b0-bd63-d7c7cdb656be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.844262 Apr 09 01:55:24.082412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 37/72] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:23 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:24.150397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "796b0a55-181d-46de-bc56-ef6bd82a13dd"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:24.155780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:24.173160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:24.174572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:24.177730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:24.179243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:24.331514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:24.344937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c58f5faa-8ea7-44b4-8304-f8c214a3a2e9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.620009 Apr 09 01:55:24.345587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 36/73] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:23 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:25.000749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-04492432-9d21-493e-9058-8ba9792673e5 req-58e375e0-b99f-44bb-932c-866d2059d502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fda47-7dce-41c1-a042-ebcab29da95d", "name": "network-vif-plugged", "status": "completed", "tag": "49e02430-bf03-47db-9526-5f7dbe52b57b"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:25.002604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:25.002604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:25.013837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-04492432-9d21-493e-9058-8ba9792673e5 req-58e375e0-b99f-44bb-932c-866d2059d502 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:25.014525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-04492432-9d21-493e-9058-8ba9792673e5 req-58e375e0-b99f-44bb-932c-866d2059d502 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:25.035135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-04492432-9d21-493e-9058-8ba9792673e5 req-58e375e0-b99f-44bb-932c-866d2059d502 service nova] Creating event network-vif-plugged:49e02430-bf03-47db-9526-5f7dbe52b57b for instance e47fda47-7dce-41c1-a042-ebcab29da95d on hv-cinder-78462 Apr 09 01:55:25.041142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-04492432-9d21-493e-9058-8ba9792673e5 req-58e375e0-b99f-44bb-932c-866d2059d502 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044587 Apr 09 01:55:25.042652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 37/74] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:55:25.115401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:25.116212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:25.126506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:25.127283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:25.128273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:25.129729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:25.518287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:25.559945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-382717c5-1845-4f98-be34-5835d2fea870 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.448542 Apr 09 01:55:25.561201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 38/75] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:25 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:25.589181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:25.590146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:25.606530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:25.607457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:25.608992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:25.609880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:25.947491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:25.960476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-46c09494-25d7-407a-b784-af2e04661f69 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.381239 Apr 09 01:55:25.961330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 39/76] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:25 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:26.595294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:26.596109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:26.604893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:26.605316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:26.606476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:26.606959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:26.827866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:26.848642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42fddbd7-28c2-424e-836c-cc948da9157c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.259600 Apr 09 01:55:26.850149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 40/77] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:26 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:26.983572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:26.984664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:26.996709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:26.997621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:26.999208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:27.000112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:27.784467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:27.798539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0251721c-bdca-454d-aabe-a2c42f2e61c1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.820765 Apr 09 01:55:27.810079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 41/78] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:26 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:27.879691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:27.880763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:27.912029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:27.920878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:27.925293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:27.926050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:28.065186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d89fd91b-2633-43c1-bfe9-6952036b08b1 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "POST /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.925502 Apr 09 01:55:28.066914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 38/79] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:55:24 2021] POST /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed/os-volume_attachments => generated 194 bytes in 3930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:28.424644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:28.444583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0c97f641-f927-4093-83fd-8f1e6c7c3b15 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.568419 Apr 09 01:55:28.445605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 42/80] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:27 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:28.819957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:28.820758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:28.890583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:28.896384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:28.897438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:28.897950 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:29.403505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-0995ffbd-feae-4cb3-a734-f401096aaff1 req-2c89fd6c-65ef-4b81-b8fe-0a1ddd79c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7113ca87-3a31-415b-b770-e7f4ce41b0cc", "tag": "2c15aeb3-3de9-476f-bed1-ad9f77db7c11"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:29.405772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:29.405772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:29.419533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-0995ffbd-feae-4cb3-a734-f401096aaff1 req-2c89fd6c-65ef-4b81-b8fe-0a1ddd79c5d5 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:29.420484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-0995ffbd-feae-4cb3-a734-f401096aaff1 req-2c89fd6c-65ef-4b81-b8fe-0a1ddd79c5d5 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:29.469982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-0995ffbd-feae-4cb3-a734-f401096aaff1 req-2c89fd6c-65ef-4b81-b8fe-0a1ddd79c5d5 service nova] Creating event network-changed:2c15aeb3-3de9-476f-bed1-ad9f77db7c11 for instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc on hv-cinder-78462 Apr 09 01:55:29.480367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-0995ffbd-feae-4cb3-a734-f401096aaff1 req-2c89fd6c-65ef-4b81-b8fe-0a1ddd79c5d5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081995 Apr 09 01:55:29.482051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 43/81] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:29.498229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d9a8cf92-a103-43a9-8a5a-29a4b8ae437c req-ec9b53b6-3e8a-43e9-ad99-475d5b2e92d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4de4dd-c73a-4ea9-8271-bc81f850217c", "name": "network-vif-plugged", "status": "completed", "tag": "09ce87aa-c7ef-40b2-84ee-1f1b872471fe"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:29.500766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:29.500766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:29.508744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:29.513633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d9a8cf92-a103-43a9-8a5a-29a4b8ae437c req-ec9b53b6-3e8a-43e9-ad99-475d5b2e92d8 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:29.514144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d9a8cf92-a103-43a9-8a5a-29a4b8ae437c req-ec9b53b6-3e8a-43e9-ad99-475d5b2e92d8 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:29.550301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d4f72251-8c1a-4f42-b4c1-b06379f66e01 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.735751 Apr 09 01:55:29.551968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d9a8cf92-a103-43a9-8a5a-29a4b8ae437c req-ec9b53b6-3e8a-43e9-ad99-475d5b2e92d8 service nova] Creating event network-vif-plugged:09ce87aa-c7ef-40b2-84ee-1f1b872471fe for instance 6b4de4dd-c73a-4ea9-8271-bc81f850217c on hv-cinder-78462 Apr 09 01:55:29.552976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 39/82] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:28 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:29.569624 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:29.570078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d9a8cf92-a103-43a9-8a5a-29a4b8ae437c req-ec9b53b6-3e8a-43e9-ad99-475d5b2e92d8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086253 Apr 09 01:55:29.570786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 44/83] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:29.571615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:29.594298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:29.594298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:29.594298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:29.594298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:29.842671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:29.853585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-04d42e12-2d34-4564-9c1a-9ae9ac94acb0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.296078 Apr 09 01:55:29.856734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 40/84] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:29 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:30.591410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:30.592929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:30.611402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:30.612669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:30.615230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:30.615853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:30.884162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:30.886841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:30.904391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:30.905849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:30.907940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:30.909848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:30.977044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:31.013831 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-90b46cae-ec27-4b61-b2df-b0c15f0d9562 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.431404 Apr 09 01:55:31.015937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 45/85] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:30 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:31.280471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:31.300129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ccb7bd11-a7f7-4698-be2d-77a95eab8634 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.428236 Apr 09 01:55:31.301339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 41/86] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:30 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:32.050821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:32.052485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:32.068693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:32.069645 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:32.071207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:32.072140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:32.328404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:32.329079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:32.339458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:32.339966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:32.340855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:32.341559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:32.573162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:32.593111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0db1974f-b56e-4459-a4be-561bd81541a7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.550041 Apr 09 01:55:32.595668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 46/87] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:32 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:32.655764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:32.673744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-750406d1-a3b9-4ef5-ad4e-b09ea056c724 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.349467 Apr 09 01:55:32.674975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 42/88] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:32 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:33.622435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:33.623812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:33.633122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:33.634022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:33.635025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:33.635651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:33.709615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:33.715809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:33.751086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:33.752026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:33.753512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:33.755061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:34.065856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:34.092434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bfca0744-6ca4-4a44-89e3-9f30ef3960b9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.472534 Apr 09 01:55:34.095954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 47/89] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:33 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:34.224045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:34.234235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-44ab976f-bbcc-4977-95d6-a7ff1fb10df9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.535053 Apr 09 01:55:34.234894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 43/90] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:33 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:35.113056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:35.114839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:35.132055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:35.132820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:35.133852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:35.134886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:35.260660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:35.271268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:35.357222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:35.363114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:35.365613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:35.373263 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:35.516692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:35.533615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5fca5dfe-42e2-4f04-b82f-8dbdba4f2667 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.418259 Apr 09 01:55:35.534359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 48/91] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:35 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:35.970947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:36.005515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-11fb7f71-0946-4a72-965e-c9421a3508c2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1321 microversion: 2.1 time: 0.754424 Apr 09 01:55:36.021134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 44/92] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:35 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:36.552832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:36.553634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:36.563312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:36.563814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:36.565022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:36.565511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:36.932454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:36.945097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0b531e23-d1e1-4ca4-9e81-132e8b32f83f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.396288 Apr 09 01:55:36.945962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 49/93] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:36 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:37.047523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:37.049368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:37.066254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.067516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:37.069377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.070779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:37.255289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-138277297", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "107997fa-4577-421c-97e5-52be9579a476"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:37.367192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:37.381862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4487d9f3-0eb6-4e66-92b1-7e9bca5d034e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1516 microversion: 2.1 time: 0.342776 Apr 09 01:55:37.382641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 45/94] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:37 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:37.395083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] validate_networks() for [('107997fa-4577-421c-97e5-52be9579a476', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:55:37.406593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:37.407805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:37.416915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.417434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:37.418288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.419136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:37.487159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'flavor' on Instance uuid 6b4de4dd-c73a-4ea9-8271-bc81f850217c {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:55:37.712909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-720cc920-f81e-48ed-acd4-ae9f031457c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c/action" status: 200 len: 32 microversion: 2.1 time: 0.310065 Apr 09 01:55:37.713840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 46/95] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:55:37 2021] POST /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 01:55:37.735162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:37.736132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:37.752483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.752483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:37.752483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:37.752483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:38.362014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:38.375186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-72c2cdcb-35a3-411e-bd95-4eea90a49877 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.650026 Apr 09 01:55:38.376671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 47/96] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:37 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:38.385765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:38.386957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:38.402247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:38.403170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:38.404819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:38.405935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:38.736259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:55:38.737334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:55:38.740349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:55:38.742685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:55:38.743729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:55:38.766434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:38.767334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:38.769289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:38.771037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:38.806316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:38.808869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:55:38.814075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for user 957d5db34f84437bbb972ed0ea8d8ae5 and project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:55:38.816497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f8446cde-d522-4f49-a283-34e04fd57037 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.438111 Apr 09 01:55:38.818075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 48/97] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:38 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:38.827739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:55:38.830665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:55:38.920022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f3deb521-fe8d-45b2-ab08-e32b6339522f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669388 Apr 09 01:55:38.922767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 50/98] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:55:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 01:55:38.939660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c3f01953-10ca-4319-bdcf-9559a55579a1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:38.940746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c3f01953-10ca-4319-bdcf-9559a55579a1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:39.048786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c3f01953-10ca-4319-bdcf-9559a55579a1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:39.048786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c3f01953-10ca-4319-bdcf-9559a55579a1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1217 microversion: 2.1 time: 0.113070 Apr 09 01:55:39.049323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 49/99] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:38 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:39.401707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:39.403377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:39.422333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:39.423732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:39.425878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:39.427636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:39.713905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:39.725172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cee7902c-5f35-4a7a-9bcc-fb0a6f225a11 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.333185 Apr 09 01:55:39.726215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 51/100] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:39 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:39.840472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:39.841698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:39.866836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:39.867662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:39.868619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:39.869126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:40.079849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:40.081563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:40.112965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:40.114405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:40.116026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:40.117144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:40.144570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:40.164149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-56dfb448-5181-46e6-a0f3-cc5efdd678dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.331943 Apr 09 01:55:40.167164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 50/101] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:39 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:40.358673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:40.394191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c8a583d3-0066-4e3b-8628-54e971755a8c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1221 microversion: 2.1 time: 0.320427 Apr 09 01:55:40.404418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 52/102] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:40 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1221 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:40.757723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:40.764414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:40.797514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:40.807129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:40.808104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:40.809129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:41.193386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:41.194631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:41.209946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:41.210633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:41.211705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:41.229348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:41.269022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:41.310332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d0345e35-e06c-4bdd-8709-5cf5a3faabc6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.559810 Apr 09 01:55:41.313624 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 51/103] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:40 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:41.427055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:41.428813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:41.438527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:41.440017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:41.441050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:41.441739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:41.845195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:41.871817 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4c3f5277-0c83-4f40-a90e-82521ad964de tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1277 microversion: 2.1 time: 0.450260 Apr 09 01:55:41.872564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 52/104] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:41 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1277 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:42.101027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:42.124880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0c54e01f-004c-482a-87e1-f76b47d3ab76 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.935504 Apr 09 01:55:42.132983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 53/105] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:41 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:42.334495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:42.335129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:42.343672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:42.344430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:42.345443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:42.346094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:42.556347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-92787884-9e00-4f91-b0bf-d42a93df5ebd req-04e6a64d-e54a-4320-bf0d-a127af1216ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7113ca87-3a31-415b-b770-e7f4ce41b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "2c15aeb3-3de9-476f-bed1-ad9f77db7c11"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:42.558255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:42.558255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:42.593287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-92787884-9e00-4f91-b0bf-d42a93df5ebd req-04e6a64d-e54a-4320-bf0d-a127af1216ef service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:42.598292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-92787884-9e00-4f91-b0bf-d42a93df5ebd req-04e6a64d-e54a-4320-bf0d-a127af1216ef service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:42.641783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-92787884-9e00-4f91-b0bf-d42a93df5ebd req-04e6a64d-e54a-4320-bf0d-a127af1216ef service nova] Creating event network-vif-plugged:2c15aeb3-3de9-476f-bed1-ad9f77db7c11 for instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc on hv-cinder-78462 Apr 09 01:55:42.650707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-92787884-9e00-4f91-b0bf-d42a93df5ebd req-04e6a64d-e54a-4320-bf0d-a127af1216ef service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098528 Apr 09 01:55:42.655923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 54/106] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:42.761842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:42.788828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ee3b2bc1-8f1f-4530-b1a6-d9d3c3b0a4c5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.456689 Apr 09 01:55:42.789941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 53/107] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:42 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:42.908520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:42.909463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:42.935945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:42.940826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:42.941749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:42.941980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:43.162607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:43.164155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:43.170828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:43.183038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-14d9848b-c11a-4c7e-87fb-1a68e23c1523 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1275 microversion: 2.1 time: 0.285084 Apr 09 01:55:43.183261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:43.184017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:43.185852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:43.186961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:43.195452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 55/108] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:42 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:43.736940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:43.758635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7c8b246a-c0fa-4295-826c-e32c2866abc7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.609783 Apr 09 01:55:43.759840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 54/109] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:43 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:43.816501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:43.818098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:43.842598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:43.843640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:43.845373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:43.859974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:44.202806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:44.203485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:44.229912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:44.236506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:44.238002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:44.239371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:44.652209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:44.663096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8e1bf40c-bbe4-42a3-8ea1-83c4529624c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.858414 Apr 09 01:55:44.664061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 56/110] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:43 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:44.782219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:44.783039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:44.792332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:44.792840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:44.793733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:44.794403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:44.933043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:44.948754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ab179445-5a6e-47b9-bec4-f53c54660624 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.749882 Apr 09 01:55:44.949694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 55/111] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:44 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:45.162410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:45.190795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7ae07d32-4dfc-4457-b517-7c8a8a27708d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.413603 Apr 09 01:55:45.191864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 57/112] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:44 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:45.681738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:45.683105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:45.691469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:45.692037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:45.692885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:45.693391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:45.976357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:45.977613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:45.986894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:45.987710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:45.989564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:45.990219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:46.334048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:46.352632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c9ebd929-0d5b-4bb7-ac9c-d3473152a9bc tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.674366 Apr 09 01:55:46.365563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 56/113] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:45 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:46.371339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:46.372059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:46.383503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:46.389678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:46.392475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:46.393172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-801efb10-eb98-4e83-99e2-7d39be70ba4c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.421460 Apr 09 01:55:46.393354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:46.393800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 58/114] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:45 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:46.393934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:46.404385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-8e9e469f-6542-49cc-91e0-d9a40318b891 req-529fc128-61c3-4d3d-9746-9f4f61201c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864d010f-f853-4864-9a69-92cf573e9790", "tag": "65fa996e-751e-49c6-9116-71a0d1bf7369"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:46.407247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:46.407247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:46.421093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8e9e469f-6542-49cc-91e0-d9a40318b891 req-529fc128-61c3-4d3d-9746-9f4f61201c99 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:46.422067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8e9e469f-6542-49cc-91e0-d9a40318b891 req-529fc128-61c3-4d3d-9746-9f4f61201c99 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:46.444085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-8e9e469f-6542-49cc-91e0-d9a40318b891 req-529fc128-61c3-4d3d-9746-9f4f61201c99 service nova] Creating event network-changed:65fa996e-751e-49c6-9116-71a0d1bf7369 for instance 864d010f-f853-4864-9a69-92cf573e9790 on hv-cinder-78462 Apr 09 01:55:46.450832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-8e9e469f-6542-49cc-91e0-d9a40318b891 req-529fc128-61c3-4d3d-9746-9f4f61201c99 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055239 Apr 09 01:55:46.451586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 59/115] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:46.632298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:46.648810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a5ae3f36-e22e-4f58-89af-6a38276151f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.274974 Apr 09 01:55:46.648810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 57/116] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:46 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:47.378233 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:47.380478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:47.396528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.397474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.399082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.400029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.437149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:47.438416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:47.453976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.454891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.456524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.457482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.745593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:47.758434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1ff6164a-8dca-4ede-96d9-ab71b38528d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.388534 Apr 09 01:55:47.759491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 60/117] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:47 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:47.765643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:47.766528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:47.777344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.778152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.780051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:47.781390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:47.810961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:47.822297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-17af1935-8b1d-4007-967d-1e063ca2a164 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.392867 Apr 09 01:55:47.822989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 58/118] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:47 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:48.045510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:48.055250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-29aaf0cb-2aa6-4995-8617-1d9232504358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1362 microversion: 2.1 time: 0.294270 Apr 09 01:55:48.055912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 61/119] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:47 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:48.776195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:48.776978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:48.796250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:48.797166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:48.798759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:48.799716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:48.842349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:48.846305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:48.902958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:48.903775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:48.905366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:48.906272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:49.524907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:49.534574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bb466f71-eb00-4fd7-b4eb-98fb1f74ce8a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.762482 Apr 09 01:55:49.535373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 59/120] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:48 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:49.540390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:49.541119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:49.549675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:49.550327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:49.551747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:49.552330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:49.618545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:49.637892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-03232c7e-ff76-4468-909d-b58de84ef265 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.800085 Apr 09 01:55:49.639178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 62/121] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:48 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:50.116280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:50.131203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a8ed5cbf-d8e4-4136-8506-7dcc72e0276a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1547 microversion: 2.1 time: 0.594207 Apr 09 01:55:50.132639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 60/122] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:49 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1547 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:50.157150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:50.158390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:50.174843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.175462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.176940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.177430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.401256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-59e59f88-335b-4130-b8ca-87bf3f133d3e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253262 Apr 09 01:55:50.401672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 63/123] 10.222.0.38 () {58 vars in 1265 bytes} [Fri Apr 9 01:55:50 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:50.505164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:50.505713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:50.527065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.540966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.542778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.543786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.562141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:50.562813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:50.578269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.578796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.579693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:50.585197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:50.821893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:55:51.143054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a907432-8090-4338-ba2e-ad10d5e50337 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 204 len: 0 microversion: 2.1 time: 0.642149 Apr 09 01:55:51.143921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 61/124] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:55:50 2021] DELETE /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 01:55:51.150487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:51.151323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:51.162186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:51.162710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:51.163593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:51.164124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:51.201980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:51.237351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f6005d82-1d93-4774-98ca-1a77f1e9e5d5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.678895 Apr 09 01:55:51.244937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 64/125] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:50 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:51.268681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:51.273441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:51.284849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:51.286219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:51.287172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:51.287892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:52.090398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:52.111920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:52.112452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8673672a-58ee-436b-b7a7-eb5f61075457 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.864707 Apr 09 01:55:52.114463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 65/126] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:51 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:52.137078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-216b86a2-6e47-4069-adc6-6f2db50b46eb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.991067 Apr 09 01:55:52.138246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 62/127] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:51 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:52.271805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:52.273718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:52.282996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:52.283874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:52.285608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:52.286487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:52.777127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:52.795616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f7fd42d2-9b78-48c9-927f-958dad0ddf1a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.528338 Apr 09 01:55:52.796976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 66/128] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:52 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:53.141006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:53.142287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:53.157514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.158569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.160322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.170806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:53.172353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.173724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:53.200957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.201783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.202930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.203665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.610077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:53.630189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6faef1d8-fe69-471a-93b1-cb89d3163f0e tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.496792 Apr 09 01:55:53.632053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 63/129] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:53 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:53.642177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:53.644070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:53.663561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.665320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.667502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.669073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.700909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:53.717685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-106c99a1-580e-4d4f-ab84-1eda963cdaae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.555131 Apr 09 01:55:53.718769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 67/130] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:53 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:53.726177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-1293eebe-0704-49f3-9f31-e84a60f347d9 req-bfb713ce-dafc-42bc-8795-b3e47a6e4d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7113ca87-3a31-415b-b770-e7f4ce41b0cc", "tag": "2c15aeb3-3de9-476f-bed1-ad9f77db7c11"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:53.730480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:55:53.730480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:55:53.751787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1293eebe-0704-49f3-9f31-e84a60f347d9 req-bfb713ce-dafc-42bc-8795-b3e47a6e4d35 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.752598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1293eebe-0704-49f3-9f31-e84a60f347d9 req-bfb713ce-dafc-42bc-8795-b3e47a6e4d35 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.783004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-1293eebe-0704-49f3-9f31-e84a60f347d9 req-bfb713ce-dafc-42bc-8795-b3e47a6e4d35 service nova] Creating event network-changed:2c15aeb3-3de9-476f-bed1-ad9f77db7c11 for instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc on hv-cinder-78462 Apr 09 01:55:53.790301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-1293eebe-0704-49f3-9f31-e84a60f347d9 req-bfb713ce-dafc-42bc-8795-b3e47a6e4d35 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069576 Apr 09 01:55:53.791599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 68/131] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:55:53.830201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:53.830201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:53.855675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.856817 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:53.857731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:53.858227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:54.164708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:54.174803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4defe1e0-d33f-4722-9599-5b8d1bbcd992 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.355125 Apr 09 01:55:54.175735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 69/132] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:53 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:54.657375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:54.659202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:54.666014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7f0df50a-bfe2-4e73-8c01-4da22eededc5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 14 microversion: 2.1 time: 1.031261 Apr 09 01:55:54.667430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 64/133] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:55:53 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 14 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 01:55:54.727380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:54.728358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:54.740670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:54.741883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:54.749843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:54.750800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:54.766274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:54.767244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:54.768380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:54.771547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:55.586938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:55.600968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4ff14fc3-c326-4164-b458-be8b60805ba7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.866497 Apr 09 01:55:55.602627 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 65/134] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:54 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:55.609641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:55.610539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:55.622364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:55.623290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:55.624970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:55.625671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:55.818750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:55.834903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0eba1098-aa01-4620-8f36-4a5872d7621c tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 1.188395 Apr 09 01:55:55.835917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 70/135] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:54 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:55.865855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:55.868106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:55.902103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:55.902624 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:55.907968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:55.911377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:56.029303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:56.040857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6baa8025-11d8-4077-83ab-1b5d23ad8030 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.435543 Apr 09 01:55:56.041590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 66/136] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:55 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:56.633928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:56.634559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:56.643348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:56.643869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:56.644762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:56.645261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:56.882794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:56.892232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-249c3c2d-75e1-4960-8217-97568870b544 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.262419 Apr 09 01:55:56.893189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 67/137] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:56 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:56.899046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:56.900045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:56.909223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:56.909831 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:56.911338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:56.911943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:57.141424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:57.152139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c090fe65-2c53-4c6f-9cee-824799fdadd8 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.257503 Apr 09 01:55:57.152794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 68/138] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:56 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:57.157842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:57.158536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:57.167416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:57.168065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:57.168783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:57.173605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:57.479944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:57.490076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-51851e9d-857e-462c-9970-f24433afd848 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.336137 Apr 09 01:55:57.490741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 69/139] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:57 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:57.915006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:57.915847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:57.931046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:57.932137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:57.933809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:57.934653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:58.180509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:58.191480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5858c607-9331-49a7-9411-90941bdbbfed tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.280821 Apr 09 01:55:58.192605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 70/140] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:57 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:55:58.204287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:58.205746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:58.215723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:58.216273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:58.217130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:58.217626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:58.300227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0316f94a-4faf-40f9-8cb3-faedd02f6121 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 14 microversion: 2.1 time: 2.455877 Apr 09 01:55:58.300974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 71/141] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:55:55 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 14 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 01:55:58.500935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:58.511934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:58.513013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:58.523050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8dd5423a-2c3a-4064-a21a-296ac80a4298 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.328943 Apr 09 01:55:58.523717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 71/142] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:58 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:58.540253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:58.540253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:58.540253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:58.540253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:58.849908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:58.866067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5ecab412-8bb0-4989-99eb-cde1740e4236 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.358671 Apr 09 01:55:58.867498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 72/143] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:58 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:59.212187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:59.213454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:59.226867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.227580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.229009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.229770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.319456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:55:59.321729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:59.337468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.338502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.340141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.341127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.553204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:59.564272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c3cadd0a-6263-4e0d-8caa-68fc19972836 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.357792 Apr 09 01:55:59.576096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 72/144] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:59 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:59.576096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:59.576934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:59.591123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.591638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.592547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.593064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.890575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:55:59.919155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f2867df5-3269-4e1d-b06c-85d989c1970d tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.351949 Apr 09 01:55:59.920412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 73/145] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:59 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:55:59.926563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:55:59.930286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:55:59.940649 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.941996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:55:59.943046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:55:59.943704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:00.190985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:00.204867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e467255c-f51a-4ac5-8ed8-533884e39040 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.282508 Apr 09 01:56:00.205960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 74/146] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:55:59 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:00.596413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:00.598122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:00.611804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:00.612351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:00.613224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:00.613724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:00.856402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:00.874718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f1025aec-5c40-4bb7-8bf6-1439ffd444b1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.285201 Apr 09 01:56:00.875833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 75/147] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:00 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:00.954528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:00.955373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:00.970483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:00.971325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:00.973071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:00.973956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:01.291291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:01.310565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7bdd5413-a857-4ca9-9945-a2731957a350 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.360840 Apr 09 01:56:01.311773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 76/148] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:00 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:01.320580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:01.321854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:01.336548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:01.337618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:01.338862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:01.339706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:01.594330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:01.605767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a7777a3b-3f2e-4fa9-b6d5-ec2b15f1254a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.292507 Apr 09 01:56:01.607906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 77/149] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:01 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:01.881069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-777b056e-5eb9-4a1c-ad8e-6cbdb98b0d89 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 14 microversion: 2.1 time: 2.570927 Apr 09 01:56:01.882424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 73/150] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:55:59 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 14 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 01:56:01.898186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:01.900109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:01.917595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:01.918885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:01.923321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:01.923849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.244603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:02.255108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-93904861-3e5f-4afa-ac4c-50852f0e182e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.364925 Apr 09 01:56:02.255796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 78/151] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:01 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:02.341682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:02.342675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:02.354313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.355185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.356981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.357815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.630436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:02.631710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:02.649925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.651202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.654197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.655476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.716695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:02.731790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7e5df515-b959-4b4e-9372-770c24688652 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1553 microversion: 2.1 time: 0.395836 Apr 09 01:56:02.732572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 74/152] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:02 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:02.904252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:02.906708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:02.934658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.936163 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:02.937991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:02.939913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:03.040735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:03.062324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ca40229a-bdb6-47bb-9efa-f68db3ad76a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.439364 Apr 09 01:56:03.064027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 79/153] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:02 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:03.147879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-34a1ea99-09a6-4806-be25-0405dcf300f0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 14 microversion: 2.1 time: 0.254909 Apr 09 01:56:03.149429 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 75/154] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:02 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 01:56:03.277938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:03.279060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:03.310108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:03.311547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:03.313714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:03.313853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:03.682479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:03.692125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ffe7a009-b2cf-4f9a-955f-fa1e7cc6b894 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.422077 Apr 09 01:56:03.692781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 80/155] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:03 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:03.752073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:03.753126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:03.771883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:03.775542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:03.777095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:03.777763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.090673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:04.091360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:04.111877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.112416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.114082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.114751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.262692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:04.309672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9bdf63b5-99d8-4bfd-8d78-6cda2f32ca10 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1511 microversion: 2.1 time: 0.561755 Apr 09 01:56:04.310812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 76/156] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:03 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:04.348743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:04.349812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:04.369958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.370535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.371426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.371923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.571858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:04.585145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a87cc578-e175-4f85-ae97-348bbf290f8f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.499547 Apr 09 01:56:04.585813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 81/157] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:04 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:04.598685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0602a1c8-b6d5-401f-bc7c-9314e5f79054 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 14 microversion: 2.1 time: 0.265839 Apr 09 01:56:04.599415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 77/158] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:04 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 01:56:04.646878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-1c57cc3b-86b1-4f70-a4fa-6da561850e80 req-382c91a1-d9af-4623-9c26-1363da21c453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864d010f-f853-4864-9a69-92cf573e9790", "name": "network-vif-plugged", "status": "completed", "tag": "65fa996e-751e-49c6-9116-71a0d1bf7369"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:04.648833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:04.648833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:04.666882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1c57cc3b-86b1-4f70-a4fa-6da561850e80 req-382c91a1-d9af-4623-9c26-1363da21c453 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.673094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1c57cc3b-86b1-4f70-a4fa-6da561850e80 req-382c91a1-d9af-4623-9c26-1363da21c453 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.711213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:04.712761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:04.733244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-1c57cc3b-86b1-4f70-a4fa-6da561850e80 req-382c91a1-d9af-4623-9c26-1363da21c453 service nova] Creating event network-vif-plugged:65fa996e-751e-49c6-9116-71a0d1bf7369 for instance 864d010f-f853-4864-9a69-92cf573e9790 on hv-cinder-78462 Apr 09 01:56:04.740045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.740573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.741442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:04.741930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:04.745813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-1c57cc3b-86b1-4f70-a4fa-6da561850e80 req-382c91a1-d9af-4623-9c26-1363da21c453 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103630 Apr 09 01:56:04.746497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 82/159] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:56:05.055546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-6ff1aa5c-31ed-46ea-a93e-44fc9a211ab9 req-26359af9-af58-4340-b191-6b0c930f5150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2d1156-bc2a-4483-890b-4b6383145eed", "name": "network-vif-deleted", "tag": "91b21ad2-0b7d-445a-9838-3744612d05b9"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:05.071631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:05.071631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:05.112614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6ff1aa5c-31ed-46ea-a93e-44fc9a211ab9 req-26359af9-af58-4340-b191-6b0c930f5150 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.113608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6ff1aa5c-31ed-46ea-a93e-44fc9a211ab9 req-26359af9-af58-4340-b191-6b0c930f5150 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.200557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-6ff1aa5c-31ed-46ea-a93e-44fc9a211ab9 req-26359af9-af58-4340-b191-6b0c930f5150 service nova] Creating event network-vif-deleted:91b21ad2-0b7d-445a-9838-3744612d05b9 for instance ca2d1156-bc2a-4483-890b-4b6383145eed on hv-cinder-78462 Apr 09 01:56:05.215199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-6ff1aa5c-31ed-46ea-a93e-44fc9a211ab9 req-26359af9-af58-4340-b191-6b0c930f5150 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168441 Apr 09 01:56:05.224605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 83/160] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:56:05.344177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:05.345304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:05.355015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.355519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.356684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.357178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.473511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:05.483527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7f828489-d94b-4059-9953-fbf3971466e8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.776853 Apr 09 01:56:05.484219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 78/161] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:04 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:05.546447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:05.574206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c209950-102c-472a-a37b-9c6c3efe68ef tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1346 microversion: 2.1 time: 0.235236 Apr 09 01:56:05.574845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 84/162] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:05 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:05.605345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:05.606804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:05.615892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.616567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.617660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.618353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.618491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:05.621969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:05.637094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.638146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.639077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:05.640912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:05.874088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8d1d9b9c-2e60-42f3-b9bb-08b7a1e26a78 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 4515 microversion: 2.1 time: 0.266517 Apr 09 01:56:05.874854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 85/163] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:05 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 4515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:05.886836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:05.900360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a344a20-220c-49f9-af12-e0c694918297 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.300371 Apr 09 01:56:05.911925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 79/164] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:05 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:06.513266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:06.523034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:06.540202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:06.541485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:06.543536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:06.544463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:06.598872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:06.600117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:06.632685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:06.639958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:06.641990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:06.643188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:06.896046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:06.896046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:06.912842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lazy-loading 'fault' on Instance uuid ca2d1156-bc2a-4483-890b-4b6383145eed {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:56:07.130033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6012e110fad3489dbc3e16b865523ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a02a873b584bde83597c4fb075430a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:07.157789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:07.162899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-22d4e277-ffdd-4876-ab11-fa91fe77eecc tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 200 len: 1351 microversion: 2.1 time: 0.571397 Apr 09 01:56:07.172283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 80/165] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:06 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 1351 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:07.172283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:07.172283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:07.187456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:07.188292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bbb31e43-e954-47e6-9b2d-a508ddbc1fc6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1317 microversion: 2.1 time: 0.683474 Apr 09 01:56:07.188849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:07.189018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 86/166] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:06 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:07.190770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:07.192375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:07.207409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:07.208129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:07.217322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:07.217835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:07.218677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:07.219346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:07.455094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3e808a3f-1df2-4e27-a773-58a040c28f40 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 9228 microversion: 2.1 time: 0.288916 Apr 09 01:56:07.456519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 81/167] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:07 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 9228 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:07.516415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:07.531175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-85f4e6b5-3e22-4683-a458-65af8b629bf3 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.340422 Apr 09 01:56:07.532636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 87/168] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:07 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:08.193850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:08.195211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:08.211854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:08.215605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:08.232509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.233572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.235089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.235967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.240043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.240526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.247506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.248024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.363538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] HTTP exception thrown: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. Apr 09 01:56:08.365621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Returning 404 to user: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:56:08.367744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ee7f0be8-c7f6-4097-b17b-193e2028bc52 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 404 len: 111 microversion: 2.1 time: 0.182560 Apr 09 01:56:08.374516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 82/169] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:08 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:56:08.470713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:08.472025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:08.487701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.491685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.494151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.496893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.580969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:08.617515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c511a0ce-487c-4ad5-b16b-48b9dba6bf9b tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1508 microversion: 2.1 time: 0.413833 Apr 09 01:56:08.618470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 88/170] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:08 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:08.635399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:08.637543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:08.653402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.653906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:08.655088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:08.655258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:09.178068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:09.190114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5bc0a5bc-0403-4c9d-a4b9-e93643b4b864 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.562487 Apr 09 01:56:09.191544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 89/171] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:08 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:09.198776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3459ef94-77f4-4e72-a996-5a722c3f8efd"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:09.200661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:09.211170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:09.211657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:09.212962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:09.213594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:09.550245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Invalid volume: volume 3459ef94-77f4-4e72-a996-5a722c3f8efd is already attached to instances: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 Apr 09 01:56:09.551481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 400 to user: Invalid volume: volume 3459ef94-77f4-4e72-a996-5a722c3f8efd is already attached to instances: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:56:09.553140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0386b756-714b-4062-b720-88ad4b54e3f9 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.360112 Apr 09 01:56:09.557896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 90/172] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:56:09 2021] POST /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790/os-volume_attachments => generated 174 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 01:56:09.793702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:09.794659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:09.830478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:09.831408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:09.835812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:09.836677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:10.040483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'services' on Instance uuid 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:56:10.333408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-444b5ada-f4a6-4879-86a3-685a03e6a570 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1/os-volume_attachments/3459ef94-77f4-4e72-a996-5a722c3f8efd" status: 202 len: 0 microversion: 2.1 time: 0.550731 Apr 09 01:56:10.334968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 91/173] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:56:09 2021] DELETE /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1/os-volume_attachments/3459ef94-77f4-4e72-a996-5a722c3f8efd => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:56:10.356175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:10.358905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:10.381130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:10.383205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:10.384367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:10.388674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:10.758616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d153518b-6fd7-430d-8164-57844e726f82 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 18356 microversion: 2.1 time: 2.292928 Apr 09 01:56:10.759320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 83/174] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:08 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 18356 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:10.766625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:10.776676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0304cfc9-7bb0-42e2-8e31-4ed5d31bd301 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.440134 Apr 09 01:56:10.787565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 92/175] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:10 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:11.786992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2124905457", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "d27784ad-10c3-40e4-be97-c8934da1309f"}]}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:11.787771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:11.788283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:11.804060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:11.804592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:11.805686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:11.806246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:11.957370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] validate_networks() for [('d27784ad-10c3-40e4-be97-c8934da1309f', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:56:12.005688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4e22e7a3-ed90-4df7-9ba0-aca86a7cf310 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 19342 microversion: 2.1 time: 0.234287 Apr 09 01:56:12.006803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 84/176] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:11 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 19342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:12.016896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:12.017653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:12.027182 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.027688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.031751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.031751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.640747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:12.679833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-85b580f3-3924-4975-a8e3-758fac67a459 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.667227 Apr 09 01:56:12.681532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 85/177] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:12 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:12.709678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:12.710653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:12.732687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.735505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.738800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.739747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.846603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] HTTP exception thrown: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. Apr 09 01:56:12.847425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Returning 404 to user: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:56:12.848479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4c85d1a8-27aa-46f2-ab5a-ab7390244853 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 404 len: 111 microversion: 2.1 time: 0.150816 Apr 09 01:56:12.849491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 86/178] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:56:12 2021] DELETE /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:56:12.858106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:12.859064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] [instance: ca2d1156-bc2a-4483-890b-4b6383145eed] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:12.868391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.869490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.870340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:12.870811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:12.964021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] HTTP exception thrown: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. Apr 09 01:56:12.966312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] Returning 404 to user: Instance ca2d1156-bc2a-4483-890b-4b6383145eed could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:56:12.969511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2afe886b-45d8-45fc-b9ab-ef1ccd8d6a94 tempest-DeleteServersTestJSON-1742269364 tempest-DeleteServersTestJSON-1742269364-project] 10.222.0.38 "GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed" status: 404 len: 111 microversion: 2.1 time: 0.114785 Apr 09 01:56:12.971469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 87/179] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:12 2021] GET /compute/v2.1/servers/ca2d1156-bc2a-4483-890b-4b6383145eed => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:56:13.026829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:13.033724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:13.071055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.071452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:13.072612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.073047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:13.270191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:56:13.270930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:56:13.271690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:56:13.272371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:56:13.273204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:56:13.293465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.294713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:13.295882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.298501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:13.316693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-32afc701-5c88-4115-9475-b6ed52edc6ae tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 21966 microversion: 2.1 time: 0.299418 Apr 09 01:56:13.317854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 88/180] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:13 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 21966 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:13.371120 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Getting quotas for project f34d1a60aadb4f3dab9ef86891796029. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:56:13.389687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Getting quotas for user 2d506e7be46042138f6199fbf9329f5d and project f34d1a60aadb4f3dab9ef86891796029. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:56:13.440061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:56:13.457668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:56:13.632866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1641827222", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "107997fa-4577-421c-97e5-52be9579a476"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:13.657474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6e600331-c71e-4e11-ac4a-f1020268aa1f tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879947 Apr 09 01:56:13.664058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 93/181] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:56:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 09 01:56:13.672226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-97768de3-94e8-4f1d-a463-75bdce3a909e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:13.672913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-97768de3-94e8-4f1d-a463-75bdce3a909e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:13.839280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] validate_networks() for [('107997fa-4577-421c-97e5-52be9579a476', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:56:13.901854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-97768de3-94e8-4f1d-a463-75bdce3a909e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:13.935513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-97768de3-94e8-4f1d-a463-75bdce3a909e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1219 microversion: 2.1 time: 0.267362 Apr 09 01:56:13.937046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 94/182] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:13 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1219 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:13.954440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:13.955214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:13.973938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.977919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:13.978871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:13.979384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:14.701928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:14.713850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96bb39fc-70ba-4e38-bc49-92b8470c514e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.775143 Apr 09 01:56:14.714189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 95/183] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:13 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:14.731851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:14.733056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:14.755186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:14.755692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:14.756580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:14.757067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:14.978033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-99277a7b-21d9-4f5e-94b0-d39f9a70a404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 23226 microversion: 2.1 time: 0.250592 Apr 09 01:56:14.978810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 96/184] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:14 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 23226 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:15.006829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:15.011434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:15.030090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.031025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.032647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.033576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.324179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:15.357403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8431a4ba-dbe7-4929-a4a2-2c1603dc3be9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1271 microversion: 2.1 time: 0.374774 Apr 09 01:56:15.361521 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 97/185] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:14 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:15.729235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:56:15.737684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:56:15.743619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:56:15.744886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:56:15.745927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:56:15.748331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:15.751942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:15.784719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.787026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.788625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.790146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.791818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.798308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:15.798308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.799006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:15.864016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:56:15.883476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for user 957d5db34f84437bbb972ed0ea8d8ae5 and project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:56:15.932694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:56:15.948746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:56:16.195114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-94970b5b-6b79-4173-9dbe-e848468ad823 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.566725 Apr 09 01:56:16.204497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 89/186] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:56:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:56:16.237170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:16.243474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:16.324248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:16.325128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:16.333488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:16.334347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:16.523715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:16.561924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-43991318-8ca0-4455-b08a-d9cb0cef5adb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.830026 Apr 09 01:56:16.564900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 98/187] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:15 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:16.606292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e0f7c2ce-afef-4a8b-aa5e-29f79fff5490 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:16.614173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e0f7c2ce-afef-4a8b-aa5e-29f79fff5490 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:16.787837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-835d9c4e-12fc-41b3-bd51-542f6bb9f5ef tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 24431 microversion: 2.1 time: 0.581316 Apr 09 01:56:16.796143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 90/188] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:16 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 24431 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:16.826049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:16.829927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:16.837500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e0f7c2ce-afef-4a8b-aa5e-29f79fff5490 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:16.854054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e0f7c2ce-afef-4a8b-aa5e-29f79fff5490 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1218 microversion: 2.1 time: 0.255218 Apr 09 01:56:16.854776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 99/189] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:16 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:16.870389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:16.873986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:16.882124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:16.885682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:17.291283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:17.314763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-81744071-5b81-4386-8421-0bafa39d14a6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1277 microversion: 2.1 time: 0.519519 Apr 09 01:56:17.315651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 91/190] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:16 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1277 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:17.597733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:17.598514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:17.615114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:17.619486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:17.620740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:17.621348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:17.836386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:17.852405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:17.885454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:17.886391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:17.888027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:17.901514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:17.962442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:17.975303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f7dcf7c0-6b4e-4099-8537-0a748357a3db tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.382235 Apr 09 01:56:17.979073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 100/191] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:17 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:17.993370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:17.998942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:18.025589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:18.037633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:18.038997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:18.039726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:18.207194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6be61e63-e64a-4868-a2c1-cef93effdc96 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 25315 microversion: 2.1 time: 0.395455 Apr 09 01:56:18.207920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 92/192] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:17 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 25315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:18.334405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:18.335170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:18.359489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:18.362345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:18.364449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:18.367154 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:18.467594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:18.492116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6ff150a2-cc1f-4ec5-9bf1-3b27ec5bd0bc tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1270 microversion: 2.1 time: 0.510999 Apr 09 01:56:18.503062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 101/193] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:17 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1270 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:18.857346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:18.867951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ac2d9995-8417-475f-9ac9-37971e5bfef1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.538118 Apr 09 01:56:18.868928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 93/194] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:18 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:19.029829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:19.031204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:19.068209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.072833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:19.077256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.081300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:19.228545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:19.228545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:19.245796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.245796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:19.245796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.246300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:19.546171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1c24af5b-3216-45a5-9d3c-9b46cce58b90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 26011 microversion: 2.1 time: 0.326604 Apr 09 01:56:19.564103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 94/195] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:19 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 26011 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:19.570752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:19.571527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:19.610457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.610963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:19.611823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:19.616614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:20.020767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:20.042949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bca079c4-af5d-4861-b42d-29866b47b9f5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1276 microversion: 2.1 time: 0.476841 Apr 09 01:56:20.044570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 95/196] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:19 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1276 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:20.076839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:20.078508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:20.099660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:20.101070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:20.103317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:20.104550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:20.526200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:20.543254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5de2931c-f93d-4b70-a661-bb21f87d1a56 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 1.535397 Apr 09 01:56:20.544612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 102/197] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:19 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:20.563682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:20.565663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:20.588129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:20.589810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:20.590878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:20.599827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:20.860436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cdc55f0d-9ecf-4713-93e2-866abcfe9f90 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 26946 microversion: 2.1 time: 0.304251 Apr 09 01:56:20.861663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 103/198] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:20 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 26946 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:21.073548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:21.074344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:21.095920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:21.096492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:21.102270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:21.104294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:21.584637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:21.595260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d652a651-2ac7-45c5-895a-4965ccaf24f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 1.527679 Apr 09 01:56:21.596357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 96/199] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:20 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:21.615566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:21.616635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:21.626066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:21.626952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:21.628221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:21.629019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.039464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:22.053911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a1785911-c8cf-4313-8e11-983e559308e7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.985944 Apr 09 01:56:22.054563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 104/200] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:21 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:22.080366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:22.080366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:22.104440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:22.105086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.105982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:22.106987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.310787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-559615a5-2bc1-4c00-8e86-55353c1cc6f7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 27628 microversion: 2.1 time: 0.250622 Apr 09 01:56:22.311802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 105/201] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:22 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 27628 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:22.554760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-58a2f04f-0a8b-4b31-9e53-b1951cbd9c64 req-cb9be8ba-0406-447b-b800-bf3853469202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b453594-dafd-4c17-b89f-99d0d71a68c8", "tag": "27a9d1fd-72cd-4f30-ad24-03981fc9fcc1"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:22.556980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:22.556980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:22.591516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-58a2f04f-0a8b-4b31-9e53-b1951cbd9c64 req-cb9be8ba-0406-447b-b800-bf3853469202 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:22.592101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-58a2f04f-0a8b-4b31-9e53-b1951cbd9c64 req-cb9be8ba-0406-447b-b800-bf3853469202 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.635511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-58a2f04f-0a8b-4b31-9e53-b1951cbd9c64 req-cb9be8ba-0406-447b-b800-bf3853469202 service nova] Creating event network-changed:27a9d1fd-72cd-4f30-ad24-03981fc9fcc1 for instance 7b453594-dafd-4c17-b89f-99d0d71a68c8 on hv-cinder-78462 Apr 09 01:56:22.649231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:22.657895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-58a2f04f-0a8b-4b31-9e53-b1951cbd9c64 req-cb9be8ba-0406-447b-b800-bf3853469202 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108348 Apr 09 01:56:22.658569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 106/202] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:56:22.665769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:22.666760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:22.684182 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:22.684694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.689344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:22.690096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:22.698961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f2afe6c1-7db9-4033-bfb4-4ba63e8180e5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 1.086314 Apr 09 01:56:22.704573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 97/203] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:21 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:23.088236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:23.089575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:23.124748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.130852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:23.134484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.139065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:23.352418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:23.365943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-79c7ee78-3fd8-4b90-b53d-b344311fa178 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.706038 Apr 09 01:56:23.368758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 107/204] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:22 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:23.379069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:23.383714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:23.400203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.400935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:23.402054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.402746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:23.694168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0ccdea09-efe3-41b4-b7e6-00b510c70f80 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 27920 microversion: 2.1 time: 0.319460 Apr 09 01:56:23.700490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 108/205] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:23 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 27920 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:23.727844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:23.729557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:23.742823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.744050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:23.745487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:23.746772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:24.166001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:24.192736 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-97d8bb2c-2c4a-4b18-8227-ed625436f12e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 1.112689 Apr 09 01:56:24.195178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 98/206] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:23 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:24.390774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:24.397653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:24.416066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:24.419083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:24.420150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:24.420661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:24.637993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:24.660713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0ab51541-34d0-483f-b83c-e53f51a98f1e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 0.928908 Apr 09 01:56:24.660713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 109/207] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:23 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:24.710002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:24.710971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:24.722212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:24.722886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:24.724571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:24.725111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:24.933567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-71a66369-6884-46f8-978f-22bb0208e81a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 28175 microversion: 2.1 time: 0.229901 Apr 09 01:56:24.934665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 110/208] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:24 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 28175 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:25.055669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:25.086355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c22ce3db-5c46-4125-879d-fa3a7986e903 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.697344 Apr 09 01:56:25.091695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 99/209] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:24 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:25.223636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:25.225817 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:25.256664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:25.257053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:25.267924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:25.272534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:25.682003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:25.683592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:25.718683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:25.719658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:25.724846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:25.733253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.242460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:27.272631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e515015d-cd31-424d-82d2-c2e11efdf4d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 2.053330 Apr 09 01:56:27.286326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 111/210] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:25 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:27.296025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-dc731a61-60ea-41ba-840b-0bef734f0817 req-b7e7cfa1-e209-416b-8c79-e73f90db06d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282be1e9-7f90-445a-bb34-976027a27d72", "tag": "7415309d-5eb7-43c1-b857-5878d458bc32"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:27.307949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:27.307949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:27.345961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-dc731a61-60ea-41ba-840b-0bef734f0817 req-b7e7cfa1-e209-416b-8c79-e73f90db06d0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:27.357525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-dc731a61-60ea-41ba-840b-0bef734f0817 req-b7e7cfa1-e209-416b-8c79-e73f90db06d0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.401118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-dc731a61-60ea-41ba-840b-0bef734f0817 req-b7e7cfa1-e209-416b-8c79-e73f90db06d0 service nova] Creating event network-changed:7415309d-5eb7-43c1-b857-5878d458bc32 for instance 282be1e9-7f90-445a-bb34-976027a27d72 on hv-cinder-78462 Apr 09 01:56:27.418189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-dc731a61-60ea-41ba-840b-0bef734f0817 req-b7e7cfa1-e209-416b-8c79-e73f90db06d0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129640 Apr 09 01:56:27.421786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 112/211] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:27.437726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:27.438334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:27.460327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:27.461064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.461951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:27.462456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.679815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:27.699243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0714a729-d3e1-43d8-a18e-33ce1c9ffc38 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1522 microversion: 2.1 time: 2.018887 Apr 09 01:56:27.700024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 100/212] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:25 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1522 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:27.716392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:27.717071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:27.732893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:27.738049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.739506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:27.740478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:27.782758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-464010fe-2810-4ccb-8ddb-a116e61a0ed5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 28466 microversion: 2.1 time: 0.357206 Apr 09 01:56:27.798461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 113/213] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:27 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 28466 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:28.305297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:28.306125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:28.328846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:28.329261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:28.330375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:28.334337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:29.393608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:29.412275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c3680cee-6953-42db-8c74-54f63d334700 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 1.706775 Apr 09 01:56:29.413392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 101/214] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:27 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:29.420305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:29.426647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:29.447944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:29.448876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:29.453198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:29.454260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:29.879596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:29.905670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9119ad84-2ae2-47e6-b956-b2d2e68fb5d4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 1.606179 Apr 09 01:56:29.906301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 114/215] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:28 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:29.922169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:29.925531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:29.957454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:29.958271 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:29.959339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:29.963977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.254269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2c7471a2-4c48-45f7-ab0c-85d51f8cc06e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 28634 microversion: 2.1 time: 0.339725 Apr 09 01:56:30.266377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 115/216] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:29 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 28634 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:30.315263 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:30.326587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f1427eb6-fced-4f5f-a333-406d27fcab63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1502 microversion: 2.1 time: 0.911813 Apr 09 01:56:30.328061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 102/217] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:29 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1502 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:30.347735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:30.349194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:30.374397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.379762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.383095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.383718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.445368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:30.446061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:30.480605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.481199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.482389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.482890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.900252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:30.916623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ab5ca187-21d7-4cca-b9e6-aedc07403bc5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1516 microversion: 2.1 time: 0.574516 Apr 09 01:56:30.939460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 116/218] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:30 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1516 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:30.965607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:30.966209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:30.977934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.978428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:30.979303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:30.979797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:31.040291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:31.064012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1f3a80b7-8e14-4cab-8089-1c6085f81cc9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.615441 Apr 09 01:56:31.065093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 103/219] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:30 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:31.275551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:31.277256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:31.290224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:31.291284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:31.292619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:31.293366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:31.405166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:31.418996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3458c3ee-3101-42f9-b318-6ff688690501 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.471737 Apr 09 01:56:31.419952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 117/220] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:30 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:31.531327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e67b7ffa-2817-4bd8-baa8-57c0d2e80a2b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 28634 microversion: 2.1 time: 0.260490 Apr 09 01:56:31.532098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 104/221] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:31 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 28634 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:32.100937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:32.102224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:32.149505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:32.151096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:32.163436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:32.167689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:32.459838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:32.461415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:32.482424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:32.482926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:32.483801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:32.495058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:32.899220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:32.943224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a4c3f51b-24b2-478e-86b3-a69d5c7d5b6a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.851251 Apr 09 01:56:32.954165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 118/222] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:32 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:32.992486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:33.002368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:33.034896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.036679 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.038638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.041869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.221428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:33.238938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-21b51f83-8273-4363-acc5-23ce74391790 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.791729 Apr 09 01:56:33.240015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 105/223] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:32 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:33.329826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-68c00f05-6cd4-4d50-9c8e-e1e992dde6e0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 28659 microversion: 2.1 time: 0.370333 Apr 09 01:56:33.331258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 119/224] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:32 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 28659 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:33.334383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:33.335659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:33.344355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.344792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.345657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.346301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.414104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'flavor' on Instance uuid e47fda47-7dce-41c1-a042-ebcab29da95d {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:56:33.518201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-90098210-2f5f-4e85-9837-dc82345d4c9f req-dad487c2-e13a-4b8f-bb05-28b082c2b653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b453594-dafd-4c17-b89f-99d0d71a68c8", "name": "network-vif-plugged", "status": "completed", "tag": "27a9d1fd-72cd-4f30-ad24-03981fc9fcc1"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:33.532734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:33.532734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:33.574518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-90098210-2f5f-4e85-9837-dc82345d4c9f req-dad487c2-e13a-4b8f-bb05-28b082c2b653 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.575467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-90098210-2f5f-4e85-9837-dc82345d4c9f req-dad487c2-e13a-4b8f-bb05-28b082c2b653 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.654117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-90098210-2f5f-4e85-9837-dc82345d4c9f req-dad487c2-e13a-4b8f-bb05-28b082c2b653 service nova] Creating event network-vif-plugged:27a9d1fd-72cd-4f30-ad24-03981fc9fcc1 for instance 7b453594-dafd-4c17-b89f-99d0d71a68c8 on hv-cinder-78462 Apr 09 01:56:33.669763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-40f46568-7609-445c-ac17-7bb55b028c6d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action" status: 200 len: 32 microversion: 2.1 time: 0.339508 Apr 09 01:56:33.671195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 106/225] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:33 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 01:56:33.682701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-90098210-2f5f-4e85-9837-dc82345d4c9f req-dad487c2-e13a-4b8f-bb05-28b082c2b653 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175109 Apr 09 01:56:33.690105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 120/226] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:33.696821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:33.697903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:33.713731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.714589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.738728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.739514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.973097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:33.973925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:33.997441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.998301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:33.998843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:33.999509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:34.641145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:34.646270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:34.653868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5dc3234a-705a-4cb7-a04e-a182f8c0e969 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 0.685302 Apr 09 01:56:34.655094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 121/227] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:33 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:34.658408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-94518176-9af4-4115-aae8-75c17a5206ad tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.976656 Apr 09 01:56:34.661686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 107/228] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:33 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:34.669550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:34.671714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:34.677011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:34.687079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:34.687592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:34.688462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:34.689122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:34.695031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:34.720033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:34.720661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:34.721638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:34.722311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:35.080545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c16e55fc-6d17-4d1e-806d-6e9f6c086579 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 31212 microversion: 2.1 time: 0.412852 Apr 09 01:56:35.081677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 122/229] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:34 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 31212 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:35.084984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:35.107014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-de29037a-fe5c-4d52-bd8b-7760d6573046 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.443324 Apr 09 01:56:35.108518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 108/230] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:34 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:35.674604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:35.676325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:35.680779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:35.682384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:35.699927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:35.702883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:35.704162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:35.706350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:35.706970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:35.707546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:35.708500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:35.709004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:36.809596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:36.821917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6506fcd6-de54-469a-827d-f057bdd80bba tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 1.145363 Apr 09 01:56:36.829573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 109/231] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:35 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:36.835634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:36.840729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:36.855893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:36.862005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:36.863226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:36.865476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:36.928548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:36.949568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c538b9d7-631d-408a-94b8-92e2fe04677a tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1319 microversion: 2.1 time: 1.280150 Apr 09 01:56:36.954521 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 123/232] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:35 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1319 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:36.969378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:36.975727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:36.998225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:36.998957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:37.001116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:37.005762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:37.071900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-075b3ab2-b5da-4dd3-90c2-609a96523498 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 34761 microversion: 2.1 time: 0.240594 Apr 09 01:56:37.072701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 110/233] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:36 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 34761 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:37.558016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:37.580014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2e17a12a-0a50-46b7-b61b-d5e43f014cc0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.613002 Apr 09 01:56:37.581755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 124/234] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:36 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:37.858612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:37.859380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:37.876541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:37.877044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:37.877970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:37.878448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:37.971708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:37.973511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:37.986933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:37.988867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:37.990533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:37.991275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:38.773972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:38.799643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-857b945a-bfab-4619-930f-77dc68b6bc1f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.945295 Apr 09 01:56:38.801357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 111/235] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:37 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:38.826305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:38.828756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:38.863273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:38.865268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:38.867228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:38.868517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:39.091926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cf66ba0c-2922-4f02-b65d-29f02a71b819 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 36007 microversion: 2.1 time: 0.288211 Apr 09 01:56:39.098336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 112/236] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:38 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 36007 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:39.117379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-8a01552d-1dbb-4263-81c5-8a8685203f47 req-f9eb6a26-61da-4c45-b530-c0a233e60405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282be1e9-7f90-445a-bb34-976027a27d72", "name": "network-vif-plugged", "status": "completed", "tag": "7415309d-5eb7-43c1-b857-5878d458bc32"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:39.120576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:56:39.120576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:56:39.160681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8a01552d-1dbb-4263-81c5-8a8685203f47 req-f9eb6a26-61da-4c45-b530-c0a233e60405 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:39.161224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8a01552d-1dbb-4263-81c5-8a8685203f47 req-f9eb6a26-61da-4c45-b530-c0a233e60405 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:39.221698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:39.235416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-8a01552d-1dbb-4263-81c5-8a8685203f47 req-f9eb6a26-61da-4c45-b530-c0a233e60405 service nova] Creating event network-vif-plugged:7415309d-5eb7-43c1-b857-5878d458bc32 for instance 282be1e9-7f90-445a-bb34-976027a27d72 on hv-cinder-78462 Apr 09 01:56:39.244905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-8a01552d-1dbb-4263-81c5-8a8685203f47 req-f9eb6a26-61da-4c45-b530-c0a233e60405 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144760 Apr 09 01:56:39.246252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 113/237] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:56:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:39.252292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c69fb9a3-25dc-4e44-82d5-e3a421c459a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1509 microversion: 2.1 time: 1.284926 Apr 09 01:56:39.256176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 125/238] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:37 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1509 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:39.295317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:39.297043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:39.314589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:39.315095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:39.317861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:39.318448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:39.684162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:39.697474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-72845099-e7e4-49d5-ae91-e3325b6d3bd7 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.445921 Apr 09 01:56:39.698168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 114/239] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:39 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:39.820158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:39.821094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:39.836237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:39.840865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:39.842597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:39.849055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:40.104965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:40.107067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:40.129644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:40.130307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:40.131433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:40.132189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:40.496647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9979b637-3164-4b50-b5b3-31899834c9e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 37358 microversion: 2.1 time: 0.395316 Apr 09 01:56:40.497402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 115/240] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:40 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 37358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 01:56:40.624986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:40.640466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8fbaeb6d-1999-4e67-817d-e7a5df20a16f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.825293 Apr 09 01:56:40.649111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 126/241] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:39 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:40.734129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:40.735554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:40.793205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:40.795029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:40.802136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:40.802953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:41.445319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:41.467733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f0ad3406-6293-400d-a951-f334f4dc98e6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1318 microversion: 2.1 time: 0.751447 Apr 09 01:56:41.470709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 116/242] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:40 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:41.511928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:41.513623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:41.534815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:41.540153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:41.542052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:41.545242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:41.680617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:41.682957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:41.712436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:41.713469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:41.719775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:41.720666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:41.879846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d92849fd-71fa-494e-a61e-cf075de1d4be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 38149 microversion: 2.1 time: 0.371701 Apr 09 01:56:41.881125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 127/243] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:41 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 38149 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:42.508143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:42.510333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:42.529004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:42.530148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:42.531733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:42.532776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:42.763658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:42.780731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-43c69a61-34ba-4831-bcde-59749a1475cd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 1.103803 Apr 09 01:56:42.782123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 117/244] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:41 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:42.900930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:42.902503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:42.950516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:42.955721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:42.963678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:42.970991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:43.327091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:43.351611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-18a941a2-63a0-4857-a689-eb87206abe87 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 38149 microversion: 2.1 time: 0.457062 Apr 09 01:56:43.353375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 118/245] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:42 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 38149 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:43.366868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ade0e685-95ec-4ce2-b1e9-ffc79c3b114f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1508 microversion: 2.1 time: 0.873573 Apr 09 01:56:43.389390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 128/246] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:42 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1508 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:43.823685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:43.825162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:43.900885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:43.901738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:43.903210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:43.904095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:44.224713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: .version_select at 0x7f966c83b268>, body: {"keypair": {"name": "tempest-keypair-218227359"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:44.265371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:56:44.271386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:56:44.466747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:44.480784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5d1e9bab-2f9f-44fc-a838-c91e7fe0813a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.666208 Apr 09 01:56:44.482010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 119/247] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:43 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:44.488539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:44.489889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:44.499106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:44.499825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:44.500858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:44.501524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:44.746586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-448aa1c0-6559-4aa2-a860-cb19a181071c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 38149 microversion: 2.1 time: 0.262860 Apr 09 01:56:44.747889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 120/248] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:44 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 38149 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:45.062852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:56:45.069364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:56:45.087819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d0d69bda-3de3-40e2-97eb-0a562106d51e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.233482 Apr 09 01:56:45.088678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 129/249] 10.222.0.38 () {62 vars in 1189 bytes} [Fri Apr 9 01:56:43 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1236 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 09 01:56:45.523617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:45.524984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:45.536716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:45.537548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:45.539105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:45.539757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:45.766459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:45.768730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:45.790569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:45.792351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:45.794581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:45.795603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:45.933922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:45.953028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-98aa49d2-b11c-416e-a16a-c4c291bb0dbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.437371 Apr 09 01:56:45.954401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 121/250] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:45 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:46.976572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:46.977816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:46.996554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:46.997921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:46.999862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:47.001112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:47.610924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:47.625472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6c908fcb-c1c1-486f-983a-4a2b8160dd63 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.656580 Apr 09 01:56:47.626788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 122/251] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:46 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:47.799079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f40a2c69-5692-47f9-855e-172ce379ef18 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 38149 microversion: 2.1 time: 2.040384 Apr 09 01:56:47.803836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 130/252] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:45 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 38149 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:48.653344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:48.665789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:48.686155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:48.687483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:48.690922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:48.699507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:48.751691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e5a75b-0aab-4464-85dd-4bd6681bd458"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:48.755206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:48.783068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:48.784049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:48.785728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:48.786710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:49.966427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:50.010737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-30fbe4f9-3146-4849-8494-2024835d63b8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 1.367264 Apr 09 01:56:50.021052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 123/253] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:48 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:50.041336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:50.043122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:50.063697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:50.064905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:50.067075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:50.068047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:50.317318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-be86ec2d-fffc-40ce-a38a-99173c1f3ccb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 200 len: 38278 microversion: 2.1 time: 0.294254 Apr 09 01:56:50.318920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 124/254] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:56:50 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 38278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:56:50.348433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1704147264", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef903f2c-70db-4778-a505-57ac9ff39c7e"}], "security_groups": [{"name": "tempest-securitygroup--456255114"}], "key_name": "tempest-keypair-218227359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:50.384864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6d23cd8e-b799-4470-9a09-3881e6d28fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642722 Apr 09 01:56:50.386926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 131/255] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:56:48 2021] POST /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments => generated 194 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:50.414343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:50.426522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:50.445222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:50.460703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:50.463330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:50.464722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:50.587095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c9ffcd23-6d04-421e-9e6d-bd6a7dd79c81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/ips" status: 200 len: 145 microversion: 2.1 time: 0.197245 Apr 09 01:56:50.596236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 132/256] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 01:56:50 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/ips => generated 145 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:50.646902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] validate_networks() for [('ef903f2c-70db-4778-a505-57ac9ff39c7e', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:56:51.047258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:51.048463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:51.062862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:51.063387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:51.064898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:51.066219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:51.600430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:51.618772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9640acd4-b512-4c10-a6f1-12c6d357caf8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.575170 Apr 09 01:56:51.620612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 133/257] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:51 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:56:51.656396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:56:51.656721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:56:51.657757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:56:51.658421 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:56:51.658892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:56:51.669097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:51.669528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:51.670619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:51.671308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:51.700835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:56:51.706962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:56:51.724984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:56:51.730628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:56:51.859757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-aefe71b4-9baf-4a61-9b5f-e30584ba63fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.538831 Apr 09 01:56:51.861982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 125/258] 10.222.0.38 () {62 vars in 1178 bytes} [Fri Apr 9 01:56:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 01:56:51.877249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:51.878739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:52.111586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:52.131127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:52.136143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:52.139049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f0e07e69-0c40-4e0f-af36-3ee10df73327 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1281 microversion: 2.20 time: 0.265736 Apr 09 01:56:52.140734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 134/259] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:51 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:56:52.645879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:52.647546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:52.664778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:52.665952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:52.668411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:52.669261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:52.962601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:52.979536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0419274f-0eb4-4406-b3ae-379a8ab0de75 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.341910 Apr 09 01:56:52.980926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 126/260] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:52 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:53.173528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:53.174249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:53.184155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:53.184682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:53.185552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:53.186042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:53.318842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:53.328909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:53.330588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:53.332704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5f23bdb-8471-4ab5-bb3f-997a4e8cbbd2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1277 microversion: 2.20 time: 0.163518 Apr 09 01:56:53.334117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 135/261] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:53 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:56:54.008182 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:54.009093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:54.019883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:54.020499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:54.021885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:54.022516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:54.363412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:54.367617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:54.377086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:54.377790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:54.378866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:54.379361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:54.865387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:54.876058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:54.877190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:54.879732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:54.882007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f4fe71ce-1165-4fd3-a564-f95fa3e6d9ae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1277 microversion: 2.20 time: 0.525182 Apr 09 01:56:54.882865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 136/262] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:54 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1277 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:56:54.921780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-09ac522e-ebea-4a0d-815f-798d557c4163 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.918485 Apr 09 01:56:54.923059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 127/263] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:54 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:55.915795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:55.916482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:55.924611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:55.925644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:55.926538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:55.927030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:55.942249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:55.942914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:55.951042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:55.951558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:55.952440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:55.952930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:56.109556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:56.120031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:56.121931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:56.123185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-48029e55-83a6-4cae-b8f7-dff70a948aa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1333 microversion: 2.20 time: 0.211540 Apr 09 01:56:56.123936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 137/264] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:55 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1333 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:56:56.198630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:56.210754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6e049eea-00fc-4245-8aed-74a71e4645e6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.272506 Apr 09 01:56:56.211525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 128/265] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:55 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:57.160878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:57.162279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:57.192658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.195961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.196970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.197514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.236901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:57.238361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:57.272261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.273625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.276760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.277288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.486496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:57.500420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:57.502821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:57.504345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-33080f6d-52d3-41f3-bcdb-ec21b96386fa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1339 microversion: 2.20 time: 0.355420 Apr 09 01:56:57.516785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 138/266] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:57 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1339 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:56:57.523274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60e1fba8-0585-4ab2-9f46-44ed770c439e"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:57.525004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:57.535940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.537014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.538080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:57.538770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:57.746743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:57.759126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b2cbb3b3-22c7-41b3-8c91-4c459ca4730b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.531842 Apr 09 01:56:57.760321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 129/267] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:57 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:58.442351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b9b02379-00aa-4d7c-8368-c873b462203c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923632 Apr 09 01:56:58.443197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 139/268] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:56:57 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:56:58.526264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:58.527628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:58.538931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:58.540029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:58.541104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:58.541745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:58.791526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:58.793225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:58.812732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:58.814154 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:58.817117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:58.817887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:58.879269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:58.905540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:58.907870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:58.910764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5f3c0a2-fae6-474e-bad6-ab8055ec57b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.389285 Apr 09 01:56:58.912506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 130/269] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:58 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:56:59.120588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:56:59.141160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1ee725c5-ebfe-430e-81f7-d5024d1cb784 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.365565 Apr 09 01:56:59.142040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 140/270] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:56:58 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:56:59.144542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e5a75b-0aab-4464-85dd-4bd6681bd458"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:56:59.145860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:59.154120 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.154961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.156086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.156776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.366679 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Invalid volume: volume 94e5a75b-0aab-4464-85dd-4bd6681bd458 is already attached to instances: 282be1e9-7f90-445a-bb34-976027a27d72 Apr 09 01:56:59.367357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 400 to user: Invalid volume: volume 94e5a75b-0aab-4464-85dd-4bd6681bd458 is already attached to instances: 282be1e9-7f90-445a-bb34-976027a27d72 {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:56:59.369524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-20875ebc-0389-4199-8e37-9a46619203e5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.229783 Apr 09 01:56:59.373881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 131/271] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:56:59 2021] POST /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments => generated 174 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 09 01:56:59.561919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:59.563535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:59.575943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.576528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.577400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.577897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.932744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:56:59.933552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:56:59.943057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.943544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.944640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:56:59.945388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:56:59.987468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'services' on Instance uuid 282be1e9-7f90-445a-bb34-976027a27d72 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:00.179159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-44dfd802-23b8-46e9-958a-ad8b8867c750 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments/94e5a75b-0aab-4464-85dd-4bd6681bd458" status: 202 len: 0 microversion: 2.1 time: 0.621062 Apr 09 01:57:00.181081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 141/272] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:56:59 2021] DELETE /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72/os-volume_attachments/94e5a75b-0aab-4464-85dd-4bd6681bd458 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:00.216870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-48b46ca5-affa-4942-9d29-c170031bca67 req-ed79bfa0-a14f-40b5-8193-1578e4508428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:00.223058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:00.223058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:00.269530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-48b46ca5-affa-4942-9d29-c170031bca67 req-ed79bfa0-a14f-40b5-8193-1578e4508428 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.270392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-48b46ca5-affa-4942-9d29-c170031bca67 req-ed79bfa0-a14f-40b5-8193-1578e4508428 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.317643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-48b46ca5-affa-4942-9d29-c170031bca67 req-ed79bfa0-a14f-40b5-8193-1578e4508428 service nova] Creating event network-changed:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 01:57:00.325959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-48b46ca5-affa-4942-9d29-c170031bca67 req-ed79bfa0-a14f-40b5-8193-1578e4508428 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141644 Apr 09 01:57:00.326662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 142/273] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:00.330474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:00.341177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:00.341946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:00.360656 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.361113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.362012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.362525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.364096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:00.370487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:00.372835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-77888dd2-0a8e-46f7-8faf-2bd26a6fbcdf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.444178 Apr 09 01:57:00.380173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 132/274] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:56:59 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:00.655762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:00.674316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-adafe288-27d6-4d36-9102-5b32ab609e0d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1502 microversion: 2.1 time: 0.338197 Apr 09 01:57:00.688034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 143/275] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:00 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1502 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:00.699419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe16dba8-6387-47eb-8380-3f7c0eb1374e"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:00.702750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:00.717577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.718481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.720113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.721000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.842159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] HTTP exception thrown: Cannot 'attach_volume' instance e47fda47-7dce-41c1-a042-ebcab29da95d while it is in vm_state rescued Apr 09 01:57:00.843100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Returning 409 to user: Cannot 'attach_volume' instance e47fda47-7dce-41c1-a042-ebcab29da95d while it is in vm_state rescued {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:57:00.844377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-39ec158d-6643-4ead-b35c-fce6e1efd8c6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.154246 Apr 09 01:57:00.849894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 133/276] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:57:00 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 01:57:00.861002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:00.861966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:00.896654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.897620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:00.907563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:00.908533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:01.133719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ca937a1d-bcfa-4365-8af4-5a10c1962f69 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action" status: 202 len: 0 microversion: 2.1 time: 0.281144 Apr 09 01:57:01.138261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 144/277] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:57:00 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:01.145604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:01.146360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:01.156399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:01.157183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:01.158026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:01.158749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:01.407387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:01.408109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:01.417813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:01.418335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:01.419328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:01.419835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:01.716689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:01.735056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-65b88150-182c-47a7-a2f3-401e5415e3e9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1510 microversion: 2.1 time: 0.595119 Apr 09 01:57:01.736188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 134/278] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:01 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:02.053773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:02.063621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:02.065910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:02.067122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f826ed00-8b9a-4826-98be-6a944b8a4149 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.665274 Apr 09 01:57:02.067927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 145/279] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:01 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:02.761197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:02.763055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:02.778596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:02.789113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:02.790043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:02.790551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:03.020867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:03.031822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9838210b-f0c4-4e13-b337-0893d7c8a0dd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1510 microversion: 2.1 time: 0.276623 Apr 09 01:57:03.032639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 135/280] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:02 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:03.090338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:03.091128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:03.100869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:03.101499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:03.102623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:03.103124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:03.352189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:03.363298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:03.364980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:03.366184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5bcfef22-7809-42a7-ab74-5547b063705c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.282547 Apr 09 01:57:03.366794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 146/281] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:03 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:04.051721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:04.052341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:04.061253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:04.061827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:04.062767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:04.063391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:04.350013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:04.366779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-abbbc670-c608-412c-8e44-5354ffaaa936 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1510 microversion: 2.1 time: 0.319877 Apr 09 01:57:04.367634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 136/282] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:04 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:04.386936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:04.387608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:04.396721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:04.397488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:04.398358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:04.398853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:04.617727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:04.628724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:04.630893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:04.636416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a507a04e-779b-4ab4-98e3-3ca92794e8ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.249663 Apr 09 01:57:04.637672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 147/283] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:04 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:05.387396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:05.388471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:05.397445 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:05.397949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:05.398824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:05.399309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:05.624494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:05.633946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-49012efd-82cf-461d-b5b3-a78436015a53 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1516 microversion: 2.1 time: 0.251806 Apr 09 01:57:05.634587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 137/284] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:05 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:05.657382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:05.658007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:05.668662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:05.669439 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:05.670312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:05.670803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:05.897137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:05.903229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:05.904976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:05.906192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bc1fdc95-15b9-4373-83e2-f8eced0c2a58 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.253014 Apr 09 01:57:05.906822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 148/285] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:05 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:06.648634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e916decc-2eef-4940-9b07-89af6cb50fa1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:06.657766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e916decc-2eef-4940-9b07-89af6cb50fa1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:06.658335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e916decc-2eef-4940-9b07-89af6cb50fa1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:06.722977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e916decc-2eef-4940-9b07-89af6cb50fa1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Going to try to stop instance {{(pid=99348) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 09 01:57:06.808347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e916decc-2eef-4940-9b07-89af6cb50fa1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.163607 Apr 09 01:57:06.809053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 138/286] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:57:06 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:57:06.819201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:06.819873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:06.828200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:06.828721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:06.829581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:06.830084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:06.936317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:06.938036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:06.949751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:06.950552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:06.951663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:06.952415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:07.427948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:07.438822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:07.439328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5db568bd-3e7c-411a-be62-9f8464bfa679 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.624896 Apr 09 01:57:07.440702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 149/287] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:06 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:07.458484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:07.459235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:07.461177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:07.464610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:07.466943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db39e158-1420-4e9e-a596-02db574a2c85 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.536409 Apr 09 01:57:07.468205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 139/288] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:06 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:07.469769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:07.470283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:07.471146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:07.472225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:07.686029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:07.697082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96ccc5b3-e427-4433-bc21-f1d05a14f501 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1516 microversion: 2.1 time: 0.243065 Apr 09 01:57:07.697884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 150/289] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:07 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:07.716020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da77d708-0901-43f3-97bf-56033128dcf8"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:07.717722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:07.726026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:07.726531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:07.727384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:07.727874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.223792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-48d1d4cc-02af-4c05-9660-f857ff589ea4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511663 Apr 09 01:57:08.224967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 140/290] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:57:07 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:08.464336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:08.466891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-33285a3c-d0b3-4689-a89b-bd0adbab04d1 req-c8219eab-c366-4787-9813-470f1ff6b80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "name": "network-vif-plugged", "status": "completed", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:08.468658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:08.468820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:08.468820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:08.483039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:08.483640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-33285a3c-d0b3-4689-a89b-bd0adbab04d1 req-c8219eab-c366-4787-9813-470f1ff6b80b service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:08.483774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.484208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-33285a3c-d0b3-4689-a89b-bd0adbab04d1 req-c8219eab-c366-4787-9813-470f1ff6b80b service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.485215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:08.486254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.507831 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-33285a3c-d0b3-4689-a89b-bd0adbab04d1 req-c8219eab-c366-4787-9813-470f1ff6b80b service nova] Creating event network-vif-plugged:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 01:57:08.523851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-33285a3c-d0b3-4689-a89b-bd0adbab04d1 req-c8219eab-c366-4787-9813-470f1ff6b80b service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061445 Apr 09 01:57:08.524618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 141/291] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:57:08.532194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:08.532971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:08.573504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:08.574014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.574885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:08.575365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:08.969908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:08.981065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3a523d5e-f6e3-441f-b1ec-2d45e6f8558f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.525977 Apr 09 01:57:08.982541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 151/292] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:08 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:08.987374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-144378442", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "107997fa-4577-421c-97e5-52be9579a476"}]}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:08.995402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:09.009904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:09.011880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:09.013319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f15c5a11-908b-4d24-995d-7c5c54561b73 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.485813 Apr 09 01:57:09.014228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 142/293] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:08 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:09.104166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] validate_networks() for [('107997fa-4577-421c-97e5-52be9579a476', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:57:09.822813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:57:09.823572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:57:09.824819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:57:09.825592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:57:09.826307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:57:09.837960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:09.838587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:09.839558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:09.840167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:09.866540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:57:09.873021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Getting quotas for user 957d5db34f84437bbb972ed0ea8d8ae5 and project 3bcfc614a87947d4801ef4e95e289ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:57:09.888254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:57:09.891670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:57:09.977897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-595e1420-0013-4e98-a02f-a96195d58cc5 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994310 Apr 09 01:57:09.978928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 152/294] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:57:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:57:09.992305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-403e8330-31af-43bb-a4bb-a8f5a905f38f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:09.992978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-403e8330-31af-43bb-a4bb-a8f5a905f38f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:10.013988 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:10.014923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:10.025204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:10.025999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:10.028134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:10.028134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:10.091389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-403e8330-31af-43bb-a4bb-a8f5a905f38f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:10.100272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-403e8330-31af-43bb-a4bb-a8f5a905f38f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1217 microversion: 2.1 time: 0.111945 Apr 09 01:57:10.101204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 143/295] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:09 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:10.105871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:10.107102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:10.129995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:10.130496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:10.131379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:10.132069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:10.419331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:10.449241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-21e4bda8-d767-41e4-b2e8-891e26076faf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.442280 Apr 09 01:57:10.449909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 153/296] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:10 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:10.500665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:10.518594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:10.523695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:10.526262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e50dadeb-5388-4883-9b32-968fcfe779bf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1406 microversion: 2.20 time: 0.423880 Apr 09 01:57:10.527559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 144/297] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:10 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:11.128906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:11.130117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:11.139711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.140332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:11.141214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.141839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:11.273819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:11.282923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3e7d56f2-6bbd-4703-9ea7-6cc0c31290aa tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1269 microversion: 2.1 time: 0.159464 Apr 09 01:57:11.283601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 154/298] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:11 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:11.472659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:11.473936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:11.490429 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.491390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:11.493011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.493947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:11.552651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:11.556322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:11.566989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.567509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:11.568491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:11.568997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:12.370508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:12.384412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-07c7dd96-47d0-47c2-b67a-c81e6586f2e7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.919009 Apr 09 01:57:12.385257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 145/299] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:11 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:12.390029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:12.390691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:12.399206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:12.399718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:12.404081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:12.404081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:12.470227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:12.496080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:12.501609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:12.503913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d93df0eb-89f8-4483-bdaa-525bff87fd33 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1597 microversion: 2.20 time: 0.957062 Apr 09 01:57:12.505514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 155/300] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:57:11 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1597 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:57:12.540955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:12.541889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:12.550095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:12.550602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:12.551855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:12.552393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:12.743318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:12.776346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f75569fc-3b7d-41fe-9882-b88c849475e0 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1275 microversion: 2.1 time: 0.389588 Apr 09 01:57:12.778135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 146/301] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:12 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1275 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:12.881733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cd5dd932-ff43-473a-b67c-ef9329bc3e42 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.344239 Apr 09 01:57:12.885733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 156/302] 10.222.0.38 () {60 vars in 1306 bytes} [Fri Apr 9 01:57:12 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-interface => generated 284 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:57:13.407542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:13.408173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:13.418653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:13.419329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:13.421425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:13.422346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:13.802428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:13.804777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:13.831940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:13.833492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:13.835816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:13.837392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:13.859619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:13.903852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-64486801-3435-48cb-a77c-68eabf04d6dc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.504438 Apr 09 01:57:13.916238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 147/303] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:13 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:14.426823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:14.455158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cdb75a76-ffbf-4c4d-8203-45ff13cec9d2 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.660731 Apr 09 01:57:14.457334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 157/304] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:13 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:14.930048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:14.938148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-e5c6ed4e-6dab-4c42-ad73-d7475b64359c req-61b3e935-4760-4593-8670-5693bdfcccfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:14.940837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:14.942190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:14.942190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:14.950676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:14.951189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:14.952104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:14.952798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:14.956507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-e5c6ed4e-6dab-4c42-ad73-d7475b64359c req-61b3e935-4760-4593-8670-5693bdfcccfb service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:14.957325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-e5c6ed4e-6dab-4c42-ad73-d7475b64359c req-61b3e935-4760-4593-8670-5693bdfcccfb service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:14.980697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-e5c6ed4e-6dab-4c42-ad73-d7475b64359c req-61b3e935-4760-4593-8670-5693bdfcccfb service nova] Creating event network-changed:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 01:57:14.987437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-e5c6ed4e-6dab-4c42-ad73-d7475b64359c req-61b3e935-4760-4593-8670-5693bdfcccfb service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054902 Apr 09 01:57:14.989319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 158/305] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:57:14.996512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:14.997601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:15.007818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:15.008883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:15.010366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:15.011210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:15.123172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-633cb28e-6e90-4784-bdd5-9a116c940ccc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.197858 Apr 09 01:57:15.124933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 148/306] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:14 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:15.428709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:15.454438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d2aef1d-ae45-490f-b6b0-40da37ce9758 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.457606 Apr 09 01:57:15.457618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 159/307] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:14 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:15.475578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:15.476442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:15.486770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:15.487285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:15.488222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:15.488721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:15.832330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-fa44deca-62d6-4d30-95b4-ee98202b32d3 req-75103963-2d2d-4a56-89c3-caeaaaf7090c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de4fa5-7bb3-4e7f-b497-63db8ea11129", "tag": "049cb625-5ff0-4774-8879-28ddd907f300"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:15.835980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:15.835980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:15.856040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fa44deca-62d6-4d30-95b4-ee98202b32d3 req-75103963-2d2d-4a56-89c3-caeaaaf7090c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:15.856976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fa44deca-62d6-4d30-95b4-ee98202b32d3 req-75103963-2d2d-4a56-89c3-caeaaaf7090c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:15.897025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-fa44deca-62d6-4d30-95b4-ee98202b32d3 req-75103963-2d2d-4a56-89c3-caeaaaf7090c service nova] Creating event network-changed:049cb625-5ff0-4774-8879-28ddd907f300 for instance e5de4fa5-7bb3-4e7f-b497-63db8ea11129 on hv-cinder-78462 Apr 09 01:57:15.919244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-fa44deca-62d6-4d30-95b4-ee98202b32d3 req-75103963-2d2d-4a56-89c3-caeaaaf7090c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094796 Apr 09 01:57:15.920539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 160/308] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:57:16.005878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:16.021153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9f4320ec-c701-4a8e-890c-8a3eb99e3421 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.550265 Apr 09 01:57:16.032352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 149/309] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:15 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:16.148601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0208e0ac-0daa-44a0-b8bb-b78455f61c43", "device": "/dev/sdb"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:16.150431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:16.160716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:16.160940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.161409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.162260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.162743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.163030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:16.184334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.185238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.186789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.187708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.464275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-415dca6e-6ef9-48ae-b701-dd9c8cfeeecb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.325164 Apr 09 01:57:16.465024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 161/310] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:16 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:16.483181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:16.485087 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:16.499604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.501237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.503049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.503735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.640170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'flavor' on Instance uuid e47fda47-7dce-41c1-a042-ebcab29da95d {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:16.753529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6d8fc555-250f-432e-8fcd-c244d87e14f6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "POST /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609092 Apr 09 01:57:16.757253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 150/311] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:57:16 2021] POST /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8/os-volume_attachments => generated 194 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:57:16.787869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:16.793594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:16.828941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.831179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:16.832139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:16.832640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.090660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6950bf21-f79c-4fc9-9703-86330c681838 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action" status: 200 len: 32 microversion: 2.1 time: 0.624114 Apr 09 01:57:17.091430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 162/312] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:57:16 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action => generated 32 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 01:57:17.099069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:17.099827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:17.109600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.110105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.111456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.111966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.210487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:17.221139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2482e739-5ea5-46e3-9f58-4e94cb970751 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.461785 Apr 09 01:57:17.233546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 151/313] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:16 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:17.239258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:17.240308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:17.249964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.250922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.252100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.253074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.669787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:17.680509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cb9d1783-6cbf-4a00-9f33-7a7980945ad6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.586768 Apr 09 01:57:17.681430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 163/314] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:17 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:17.693680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:17.695868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:17.721613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.722213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.723247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:17.723811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:17.740495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:17.768899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1fb3c06b-862b-4367-b1d8-5aecfd31dbdb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.533128 Apr 09 01:57:17.770213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 152/315] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:17 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:17.899340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-12bff75a-670b-4bfb-9718-e402c3b3a0b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.211344 Apr 09 01:57:17.901652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 164/316] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:17 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:18.241813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:18.242786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:18.252047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.253204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.254092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.254639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.482183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:18.498877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7bfc6103-b637-4291-80c6-b4aab869a992 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.261274 Apr 09 01:57:18.503681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 153/317] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:18 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:18.700201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:18.700977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:18.710787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.711303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.712231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.712709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.799042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:18.799767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:18.812367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.812876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.813744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.814234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.937591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:18.947810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-012dd962-ca80-46ca-b638-e23683221264 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.252268 Apr 09 01:57:18.948499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 165/318] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:18 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:18.953730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:18.954713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:18.967566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.968600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:18.970067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:18.970987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:19.100921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:19.111426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-621a48b0-cb09-4c41-97e6-ee73a95c87d6 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.316822 Apr 09 01:57:19.112705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 154/319] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:18 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:19.183238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a54e125c-f71e-471f-b2dd-1276bba7b803 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.233325 Apr 09 01:57:19.184142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 166/320] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:18 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:19.530230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:19.531173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:19.541051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:19.541532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:19.542377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:19.542860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:19.805274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:19.817312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f1325fec-e22c-4381-abba-2406beee6ce3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.295039 Apr 09 01:57:19.818284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 155/321] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:19 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:19.969100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:19.969876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:19.979882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:19.980486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:19.981410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:19.981958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.137008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:20.138708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:20.156104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.156574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.157449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.158205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.237881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:20.266028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-267ce249-938e-473e-a6ea-b1eb63113d49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.301151 Apr 09 01:57:20.267415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 167/322] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:19 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:20.278581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:20.280773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:20.300381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.301314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.302915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.303841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.503080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:20.513567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ae1b2f86-895b-46a8-8045-0f298b8acfd9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.385782 Apr 09 01:57:20.514514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 156/323] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:20 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:20.516290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eea48e6c-da8c-43b4-9ead-03ae1311c6ab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.246037 Apr 09 01:57:20.522436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 168/324] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:20 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:20.837515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:20.838195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:20.846901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.847449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:20.848360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:20.848858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.299815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:21.300620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:21.308492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:21.309866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.310592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.311599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.312263 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.329418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-25f78093-ba16-4e9f-aa48-c6a37120c1b8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.495597 Apr 09 01:57:21.333349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 157/325] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:20 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:21.536926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:21.539013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:21.543947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:21.555031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.555344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f16437e4-aa26-4629-9065-13de45f1b36e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.260111 Apr 09 01:57:21.555944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.556231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 169/326] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:21 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:21.558252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.559187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.578149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:21.579674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:21.589687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.590339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.591327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:21.591958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:21.756665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c4f01c45-a752-49d4-9537-fa28890e0e82 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.228289 Apr 09 01:57:21.762130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 158/327] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:21 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:21.806143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:21.816645 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5f49f601-6013-4045-adfa-d067e20390a8 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.251917 Apr 09 01:57:21.817295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 170/328] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:21 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:22.360084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:22.360897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:22.370036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.370542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.371402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.371900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.582876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:22.584928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:22.602885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.603948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.605485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.606632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.613156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:22.647564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-392c1cc7-fb26-4fea-b906-24cb1d24288c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.291733 Apr 09 01:57:22.649839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 159/329] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:22 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:22.772083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:22.773292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:22.781869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.782491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.783497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.784105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.944980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:22.954395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6a039f8b-5d83-4966-ae6d-45e11b2dd4b4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.376644 Apr 09 01:57:22.955060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 171/330] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:22 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:22.960672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:22.961337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:22.970332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.970997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.971858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:22.972397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:22.987848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3ac1b315-cc8d-4b46-9864-153d4b50d0a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.221015 Apr 09 01:57:22.989627 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 160/331] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:22 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:23.193050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:23.203221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8963c692-f837-4e81-a57f-e20b3f9eab0f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.246383 Apr 09 01:57:23.203876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 172/332] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:22 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:23.671869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:23.672834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:23.681844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:23.682349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:23.683212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:23.683707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:23.948066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:23.958326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-790f30f0-af8c-4064-b2b4-d2c80a71589f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.291457 Apr 09 01:57:23.958996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 161/333] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:23 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:23.975538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:23.976238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:23.985345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:23.985853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:23.987271 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:23.987764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.001417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:24.003074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:24.011348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:24.011845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.012719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:24.013209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.188389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a936e283-3157-462f-9f4e-2e09245e9cf9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.190308 Apr 09 01:57:24.193347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 162/334] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:23 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:24.217413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:24.224056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:24.224904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:24.228716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9c07dde3-cbcf-456e-8509-da09899faf10 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.257266 Apr 09 01:57:24.229577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 173/335] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:23 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:24.236018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:24.237307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.238370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:24.239037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.456314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:24.466466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b58a1a5a-e3f9-4931-bd3b-b1bf1a4e9d43 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.247288 Apr 09 01:57:24.467325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 163/336] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:24 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:24.516585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-57c1b9d0-4ad2-4215-9d9f-7db57caa279d req-af95118a-f3b4-456d-bc04-2b4c000644ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de4fa5-7bb3-4e7f-b497-63db8ea11129", "name": "network-vif-plugged", "status": "completed", "tag": "049cb625-5ff0-4774-8879-28ddd907f300"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:24.519042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:24.519042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:24.528958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-57c1b9d0-4ad2-4215-9d9f-7db57caa279d req-af95118a-f3b4-456d-bc04-2b4c000644ca service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:24.529466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-57c1b9d0-4ad2-4215-9d9f-7db57caa279d req-af95118a-f3b4-456d-bc04-2b4c000644ca service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:24.553382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-57c1b9d0-4ad2-4215-9d9f-7db57caa279d req-af95118a-f3b4-456d-bc04-2b4c000644ca service nova] Creating event network-vif-plugged:049cb625-5ff0-4774-8879-28ddd907f300 for instance e5de4fa5-7bb3-4e7f-b497-63db8ea11129 on hv-cinder-78462 Apr 09 01:57:24.558870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-57c1b9d0-4ad2-4215-9d9f-7db57caa279d req-af95118a-f3b4-456d-bc04-2b4c000644ca service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046404 Apr 09 01:57:24.559555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 174/337] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:24.982148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:24.983691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:24.999431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.000368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.001780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.002864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.203518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:25.205901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:25.214922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.215438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.216412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.216915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.221071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:25.232796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-758f80d3-61b7-438c-b402-700f45bd1660 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.258585 Apr 09 01:57:25.240538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 164/338] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:24 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:25.259110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:25.260066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:25.272315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.272880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.273987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.274491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.482051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:25.491613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6aaaf655-344b-46de-816e-1f74a7e25c39 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.237553 Apr 09 01:57:25.492310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 165/339] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:25 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:25.497020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:25.497673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:25.505599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.506100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.506939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:25.508380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:25.720475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:25.731916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c010934-a278-4224-ae4f-3589a2000342 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.238375 Apr 09 01:57:25.732769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 166/340] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:25 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:25.856888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6c362169-4669-4e4b-b86a-47d62293f815 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 0.658199 Apr 09 01:57:25.861567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 175/341] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:25 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:26.251746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:26.252477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:26.260700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.261209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.262068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.262731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.510709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:26.511484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:26.513977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:26.523451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.524373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.524935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b2a5e537-7694-4a5f-85cc-29389f3da2d8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.277298 Apr 09 01:57:26.525499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.525689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 167/342] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:26 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:26.526321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.741644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:26.751289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:26.751964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:26.753378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-54fe7f26-ba1e-4304-89a7-551f2ba6d75f tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.247229 Apr 09 01:57:26.754219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 176/343] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:26 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:26.761422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.761928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.762787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.763283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.876476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:26.879263 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:26.895854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.898913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:26.901066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:26.902347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:27.051954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:27.061741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-959ef8bd-79e4-4c91-9f98-b88389ffeafe tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.314572 Apr 09 01:57:27.062403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 168/344] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:26 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:27.544405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:27.545066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:27.553634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:27.554136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:27.554987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:27.555475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:27.772379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:27.791721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ff541f35-187d-4528-8590-322401eb3451 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.250893 Apr 09 01:57:27.793026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 169/345] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:27 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:27.797886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:27.798556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:27.806671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:27.807177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:27.808075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:27.808553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:28.020520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:28.029217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-221a13ed-855d-4196-8c8b-5983676cd0c1 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.235007 Apr 09 01:57:28.029890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 170/346] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:27 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:28.081651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:28.082356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:28.090909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:28.091406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:28.092309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:28.092793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:28.297331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:28.307644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-30b28699-defa-400b-871e-34e0017de42b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.230561 Apr 09 01:57:28.308329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 171/347] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:28 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:28.810923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:28.811595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:28.820378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:28.820901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:28.821781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:28.822272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:29.026915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:29.036907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-acbff119-39dc-4ba3-960f-89188d207bdb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.230031 Apr 09 01:57:29.037563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 172/348] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:28 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:29.047016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:29.047602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:29.056085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:29.056584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:29.057407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:29.057890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:29.265628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:29.274779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0b0dabaa-ccee-4ba8-bbf7-3718d81294bb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.231778 Apr 09 01:57:29.275433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 173/349] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:29 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:29.326845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:29.327468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:29.335820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:29.336363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:29.337271 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:29.337761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:29.539125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:29.548585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-869af393-c358-463c-9210-9e3f52b0e53c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.225946 Apr 09 01:57:29.549841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 174/350] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:29 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:30.055672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:30.056436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:30.064514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.065081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.065955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.066469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.242922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-74ee8192-a7fd-483d-b436-9ec4e0a19a56 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 3.374705 Apr 09 01:57:30.244031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 177/351] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:26 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 3377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:30.294109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:30.294881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:30.305106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.305783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.306678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.307574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.318395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:30.330064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9c1bd960-0b8b-4e75-8da0-d750118115e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.278300 Apr 09 01:57:30.331516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 175/352] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:30 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:30.520454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:30.529729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6cf6b354-50a0-4e36-9e91-a3f8aa59b304 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1317 microversion: 2.1 time: 0.240488 Apr 09 01:57:30.530394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 178/353] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:30 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:30.568591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:30.569420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:30.582468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.583377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.584879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:30.585777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:30.837329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:30.860758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4c416883-36a6-4a12-886d-76529e87a4ce tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.296669 Apr 09 01:57:30.862894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 176/354] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:30 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:31.256955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:31.258004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:31.266261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.266772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.267632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.268764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.349629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:31.350219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:31.358859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.359375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.360936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.360936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.613282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:31.623433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6671e2b0-9242-441a-91c1-5852107ed9f5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.277893 Apr 09 01:57:31.624127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 177/355] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:31 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:31.629143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:31.629823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:31.639095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.640048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.641301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.641949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.858750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:31.878012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0a897ddb-9258-4e1d-aa4a-e28cb31441ae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1507 microversion: 2.1 time: 0.251700 Apr 09 01:57:31.879161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 178/356] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:31 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:31.890305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:31.891673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:31.907915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.909557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:31.911333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:31.912514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:32.142511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:32.163148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-28d14c08-474e-462b-9a01-fd1622e0a92e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.276644 Apr 09 01:57:32.164191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 179/357] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:31 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:32.554124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bf7d81c4-04c9-4964-bded-f9efba89e8ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 14 microversion: 2.20 time: 1.301572 Apr 09 01:57:32.555356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 179/358] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:31 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 14 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:32.646768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:32.647523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:32.655840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:32.656372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:32.657380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:32.657871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:32.870737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:32.881489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6b262ea3-a2ff-44b9-b766-531255255313 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.239698 Apr 09 01:57:32.882148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 180/359] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:32 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:33.189814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:33.190593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:33.199612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.200150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:33.201016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.201522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:33.405471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:33.415910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-941e1cbc-5ae5-43d9-a836-80c4d2f0586c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.230730 Apr 09 01:57:33.416618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 180/360] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:33 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:33.568814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:33.569998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:33.578979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.579138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:33.580634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.581142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:33.904242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:33.905375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:33.918989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.919822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:33.920947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:33.921498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:34.129923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:34.139709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-74dace74-425c-4a6a-b96e-8e88af346eeb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.242454 Apr 09 01:57:34.140423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 181/361] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:33 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:34.434981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:34.435654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:34.444869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:34.445378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:34.446232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:34.446731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:34.645753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:34.655616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1a19ecf4-65ba-4b61-845d-d7a0bf121532 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.224667 Apr 09 01:57:34.656288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 182/362] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:34 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:34.671577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-401a7a1d-9750-4e66-b107-a35b5cfaa83e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 12639 microversion: 2.20 time: 1.106799 Apr 09 01:57:34.672557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 181/363] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:33 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 12639 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:35.159118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:35.159728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:35.168527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.169033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.169900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.170388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.395087 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:35.415349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5e7cbf5d-1825-46e1-b4a1-8bf80a3dc69c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1722 microversion: 2.1 time: 0.260393 Apr 09 01:57:35.416733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 183/364] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:35 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:35.689054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:35.691407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:35.696823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:35.698539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:35.712662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.713682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.714804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.715562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.717602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.718467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.719922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.720837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.913792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4307d1ae-1415-43f4-8ac2-79437f4ce684 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 15531 microversion: 2.20 time: 0.232037 Apr 09 01:57:35.914485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 184/365] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:35 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 15531 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:35.923947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ed90352-e818-49e8-8858-9f83f7f2d2fc"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:35.925264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:35.934359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.934873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.935745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:35.936302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:35.946895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:35.959883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3589a4fa-f06a-4cc0-9261-2ba5d6c75be5 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.287288 Apr 09 01:57:35.961195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 182/366] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:35 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:36.444009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:36.444742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:36.452826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:36.453253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:36.454088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:36.454569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:36.680650 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:36.690843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1daf18b8-4f68-4f41-bc64-257567f91150 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1699 microversion: 2.1 time: 0.250918 Apr 09 01:57:36.691922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 183/367] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:36 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1699 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:36.712931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a22ef5d1-271c-49d3-a124-484eb682b0dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:36.723097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a22ef5d1-271c-49d3-a124-484eb682b0dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:36.731978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a22ef5d1-271c-49d3-a124-484eb682b0dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:36.796992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a22ef5d1-271c-49d3-a124-484eb682b0dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Going to try to start instance {{(pid=99348) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 09 01:57:36.881013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a22ef5d1-271c-49d3-a124-484eb682b0dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.172360 Apr 09 01:57:36.881668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 184/368] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:57:36 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:36.890929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:36.891693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:36.901091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:36.901401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:36.902255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:36.902738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:37.112756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:37.122248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f1455480-cb1f-4a45-958c-738fea20213e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1708 microversion: 2.1 time: 0.235879 Apr 09 01:57:37.122882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 185/369] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:36 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1708 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:37.129422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:37.130517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:37.138268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:37.138769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:37.139596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:37.140110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:39.025869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-244c9d27-70d6-4030-806b-ea4815eedd38 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 21519 microversion: 2.20 time: 1.900625 Apr 09 01:57:39.026512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 186/370] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:37 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 21519 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:39.032166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:39.032941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:39.042608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:39.043119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:39.043979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:39.044494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:39.202841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5b02bca0-c8c4-42f4-a51e-b5a2f812f069 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "POST /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.283208 Apr 09 01:57:39.203582 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 185/371] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:57:35 2021] POST /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129/os-volume_attachments => generated 194 bytes in 3288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:39.218779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:39.219844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:39.230812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:39.231460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:39.233247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:39.233857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:39.286171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:39.307981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-27b09278-52a0-4404-b1bc-c45f056274ef tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.278355 Apr 09 01:57:39.310699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 187/372] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:39 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:39.486573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:39.501291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8533982b-5f62-4100-b255-03937a888640 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1708 microversion: 2.1 time: 0.296202 Apr 09 01:57:39.502484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 186/373] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:39 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1708 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:40.039883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:40.040944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:40.049846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.050351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.051189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.051668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.205291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2dec43d-a671-40fb-9a15-990af71c9e05 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 22765 microversion: 2.20 time: 0.169216 Apr 09 01:57:40.206768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 188/374] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:40 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 22765 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:40.327042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:40.327711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:40.336895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.337413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.338361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.338866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.532065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:40.532877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:40.542816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.543324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.544241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:40.544734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:40.545740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:40.558898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ec110be6-999d-4bb7-9ba5-24256ef63d74 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.235853 Apr 09 01:57:40.559553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 187/375] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:40 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:40.771729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:40.781402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b4394b1e-f0ce-4e97-948b-4ecc92bcb2c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1708 microversion: 2.1 time: 0.254196 Apr 09 01:57:40.782057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 189/376] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:40 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1708 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:41.218527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:41.219908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:41.229241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.229750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.230620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.231122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.376022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2c3fe716-cc89-4e57-b2ee-4d056ee3decb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 23227 microversion: 2.20 time: 0.161395 Apr 09 01:57:41.376955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 188/377] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:41 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 23227 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:41.587813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:41.588564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:41.597957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.598476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.599358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.599842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.803841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:41.803841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:41.817276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.817676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.818547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:41.819042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:41.821140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:41.833011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-47834375-00dc-473c-963f-1c938adccb67 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.249286 Apr 09 01:57:41.833966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 190/378] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:41 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:42.075068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:42.085661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5d8770ed-f6f5-4deb-9c2a-7ac5a9d32890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1712 microversion: 2.1 time: 0.288282 Apr 09 01:57:42.086320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 189/379] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:41 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1712 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:42.388536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:42.389732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:42.398461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:42.398942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:42.399789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:42.400297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:42.577569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7829e156-642c-4a7f-9c2d-71f4a2ff4242 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 24144 microversion: 2.20 time: 0.192712 Apr 09 01:57:42.578672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 191/380] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:42 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 24144 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:42.863794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:42.865012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:42.880934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:42.881842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:42.883401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:42.884353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:43.116846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:43.126076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-262e0d97-f8ba-4202-8f98-e122a1fd76c0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.271024 Apr 09 01:57:43.126701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 190/381] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:42 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:43.387193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:43.387871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:43.397549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:43.398189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:43.398895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:43.399389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:43.582935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lazy-loading 'services' on Instance uuid 7b453594-dafd-4c17-b89f-99d0d71a68c8 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:43.591967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:43.593279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:43.602572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:43.603252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:43.604349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:43.604957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:43.761487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e47c053e-7076-482c-a57e-8b3246178711 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8/os-volume_attachments/0208e0ac-0daa-44a0-b8bb-b78455f61c43" status: 202 len: 0 microversion: 2.1 time: 0.378638 Apr 09 01:57:43.762501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 192/382] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:57:43 2021] DELETE /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8/os-volume_attachments/0208e0ac-0daa-44a0-b8bb-b78455f61c43 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:43.774170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b191d15-5bd0-4ca4-90ab-c5980f3874cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 24891 microversion: 2.20 time: 0.185757 Apr 09 01:57:43.776695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 191/383] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:43 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 24891 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:57:44.146485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:44.147253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:44.155713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:44.156404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:44.157269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:44.157762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:44.366996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:44.376544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-772c29d3-21dc-4cd5-a244-6b6cb47b94f7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.234686 Apr 09 01:57:44.377719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 193/384] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:44 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:44.789145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:44.790303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:44.800661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:44.801169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:44.802055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:44.802552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:44.965046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-51b4a490-f973-42bb-89e8-fc7fbb8b0aab tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 25731 microversion: 2.20 time: 0.178334 Apr 09 01:57:44.967317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 192/385] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:44 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 25731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:45.395942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:45.396778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:45.405785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:45.406479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:45.407370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:45.407857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:45.611008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:45.621036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-07ad53e3-ec8a-48fd-af2e-90ceccf13351 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.229817 Apr 09 01:57:45.621675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 194/386] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:45 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:45.982604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:45.984085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:45.993351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:45.993858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:45.994698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:45.995196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:46.179045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d19672f-aadf-4628-94f8-6478e80b32ac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 26433 microversion: 2.20 time: 0.199825 Apr 09 01:57:46.187728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 193/387] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:45 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 26433 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:46.640102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:46.640862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:46.649282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:46.649794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:46.650656 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:46.651152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:46.863707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:46.873554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5b5d0c2-45cd-49d4-b5d6-c80b88acf1e1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.237595 Apr 09 01:57:46.874205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 195/388] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:46 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:47.195770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:47.196991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:47.206368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.206875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.207778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.208418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.415448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fa2723e7-cd8a-43d1-8181-d63357a551ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 26895 microversion: 2.20 time: 0.223374 Apr 09 01:57:47.420251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 194/389] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:47 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 26895 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:47.458026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1464583484", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:47.534871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] validate_networks() for None {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:57:47.826969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:57:47.827438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:57:47.828041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:57:47.828499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:57:47.828961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:57:47.839186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.839683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.840589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.841072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.861739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Getting quotas for project e7bba559dd0c4915b7d88a224a90d318. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:57:47.866199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Getting quotas for user 94892444240e4a65b8363928903c8428 and project e7bba559dd0c4915b7d88a224a90d318. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:57:47.877849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:57:47.880500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:57:47.896055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:47.897160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:47.907398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.908985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.910173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:47.910888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:47.940797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d3e11f0d-016e-4e21-9cb5-611d310d6ce6 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487705 Apr 09 01:57:47.950170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 196/390] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:57:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:57:47.960673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3d70dcab-9d4a-4d2c-a1b9-e45625c7e055 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:47.961528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3d70dcab-9d4a-4d2c-a1b9-e45625c7e055 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:48.090369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3d70dcab-9d4a-4d2c-a1b9-e45625c7e055 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:48.106678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3d70dcab-9d4a-4d2c-a1b9-e45625c7e055 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1215 microversion: 2.1 time: 0.152235 Apr 09 01:57:48.107700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 197/391] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:47 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:48.207152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:48.218739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b331185f-9ed8-4851-8c9c-74e5462f5286 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.329427 Apr 09 01:57:48.219528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 195/392] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:47 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:48.432661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:48.434133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:48.443583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:48.444513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:48.445506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:48.446481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:48.634798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b9450893-8feb-441a-ba95-82c579f758cc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 27429 microversion: 2.20 time: 0.207212 Apr 09 01:57:48.642169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 198/393] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:48 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 27429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:48.694489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:48.695077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:48.703704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:48.704240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:48.705193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:48.705734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:48.927875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'services' on Instance uuid e5de4fa5-7bb3-4e7f-b497-63db8ea11129 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:49.080216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b94adc8f-af93-4e17-8711-a366a7d453cb tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129/os-volume_attachments/4ed90352-e818-49e8-8858-9f83f7f2d2fc" status: 202 len: 0 microversion: 2.1 time: 0.390624 Apr 09 01:57:49.080882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 196/394] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:57:48 2021] DELETE /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129/os-volume_attachments/4ed90352-e818-49e8-8858-9f83f7f2d2fc => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:49.132844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:49.134507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:49.150769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.151648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.153197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.154030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.258695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:49.261148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:49.278200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.279240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.281111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.282178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.297807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:49.308227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b738674a-f9ae-46ef-8b39-ae265c596c95 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1267 microversion: 2.1 time: 0.184942 Apr 09 01:57:49.309205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 199/395] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:49 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:49.533335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:49.543311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-570123c9-488f-421b-98a5-1c1fd69c8b12 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.299214 Apr 09 01:57:49.544060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 197/396] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:49 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:49.650033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:49.651258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:49.660488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.661011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.662052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.662501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.682995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:49.683832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:49.692512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.693030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.693900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.694401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.767040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:57:49.819843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f973a772-3ee5-45cc-ba71-e4e1df279443 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 27625 microversion: 2.20 time: 0.173928 Apr 09 01:57:49.824541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 200/397] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:49 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 27625 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:49.908413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d3a30ed4-fabc-473c-91f8-1cf53054f45b tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 204 len: 0 microversion: 2.1 time: 0.228170 Apr 09 01:57:49.912096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 198/398] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:57:49 2021] DELETE /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:57:49.920470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:49.921354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:49.931358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.932016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:49.932874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:49.933365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.186419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:50.205484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4210c240-fa12-4d2e-8ea2-606a2399c40d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1515 microversion: 2.1 time: 0.288661 Apr 09 01:57:50.206723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 201/399] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:49 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:50.334577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:50.335837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:50.357710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.359079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.362266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.363258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.504451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:50.514551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c437300b-cc16-4f7f-b330-9e0870bc5b53 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1273 microversion: 2.1 time: 0.189351 Apr 09 01:57:50.515300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 199/400] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:50 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:50.563780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:50.565049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:50.573681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.574224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.575116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.575642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.801977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:50.822632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b889b20e-c8c7-4263-97d1-e990e67ebbcf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.262957 Apr 09 01:57:50.824018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 202/401] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:50 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:50.834897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:50.837056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:50.863778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.864527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:50.866046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:50.866919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.069169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e6b307f3-7275-4185-844e-4e3cb7ca812b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 27897 microversion: 2.20 time: 0.239910 Apr 09 01:57:51.069931 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 200/402] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:50 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 27897 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:51.235442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:51.236273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:51.245474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.245987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.246895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.247392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.508167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:51.520798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-46a7429d-26b5-43a8-a458-d2cddee575f7 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1515 microversion: 2.1 time: 0.290597 Apr 09 01:57:51.521502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 203/403] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:51 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:51.552541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:51.554444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:51.569216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.570418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.571519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.572211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.850274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:51.854093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:51.854776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:51.861456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-83d723e0-e3af-498f-a5cf-a1c8dca1ed5b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.320355 Apr 09 01:57:51.863032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 201/404] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:51 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:51.868512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.869376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:51.870300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:51.870812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.084121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:52.085370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:52.094721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.095301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.096893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.097392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.144786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:52.155912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8e3ed1eb-f401-4325-837b-49998dbdb78c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.305995 Apr 09 01:57:52.157195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 204/405] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:51 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:52.332652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a99ba83f-18f8-4910-8234-b6e5d0f95bc3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28151 microversion: 2.20 time: 0.252993 Apr 09 01:57:52.337024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 202/406] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:52 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28151 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:57:52.554489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:52.555139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:52.565630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.566156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.567089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.567581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.869201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:52.887761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:52.888909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:52.909972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4f7153a2-ead9-40c0-b5ef-1403b7595bf0 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1515 microversion: 2.1 time: 0.359934 Apr 09 01:57:52.911685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 205/407] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:52 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1515 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:52.917199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.917905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.918927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.919574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.932983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:52.933533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:52.942542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.943046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:52.943907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:52.944420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:53.019502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:57:53.171626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eb554eb9-9222-450a-9546-889ce7235d50 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 204 len: 0 microversion: 2.1 time: 0.242285 Apr 09 01:57:53.176453 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 206/408] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:57:52 2021] DELETE /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 01:57:53.183109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:53.184297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:53.358816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:53.359235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:53.360193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:53.360691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:53.680319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:53.699079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e3b20911-bd4a-4c11-88e2-4264ca3a796f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.815353 Apr 09 01:57:53.703210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 203/409] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:52 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:53.710795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:53.712228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:53.720633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:53.721126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:53.722112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:53.722598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.034776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:54.054726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-78f34eff-854f-4736-9b07-f06f356ebb85 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.875671 Apr 09 01:57:54.065270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 207/410] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:53 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:54.067562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:54.069343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:54.084901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.085739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.087255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.088239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.301278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-923cac44-436d-4926-8f09-c32c383ab9ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28151 microversion: 2.20 time: 0.243391 Apr 09 01:57:54.302327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 208/411] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:54 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28151 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:54.308497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:54.309521 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:54.319239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.320097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.321171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.321683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.395547 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:54.405122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a646d85-ba4b-40d4-82e8-16f168a18716 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1513 microversion: 2.1 time: 0.703146 Apr 09 01:57:54.405754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 204/412] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:53 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1513 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:54.421577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-aa5e2e0e-223a-4835-ad13-c78a54742663 req-e350c807-643a-4c49-bbb8-b1496cd30a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755a60f-d086-457a-be62-04cff72a943e", "tag": "9be3ee1c-cebd-42af-838e-59ecd8031e82"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:54.424215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:54.424215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:54.433854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-aa5e2e0e-223a-4835-ad13-c78a54742663 req-e350c807-643a-4c49-bbb8-b1496cd30a46 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.434349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-aa5e2e0e-223a-4835-ad13-c78a54742663 req-e350c807-643a-4c49-bbb8-b1496cd30a46 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.453706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-aa5e2e0e-223a-4835-ad13-c78a54742663 req-e350c807-643a-4c49-bbb8-b1496cd30a46 service nova] Creating event network-changed:9be3ee1c-cebd-42af-838e-59ecd8031e82 for instance 6755a60f-d086-457a-be62-04cff72a943e on hv-cinder-78462 Apr 09 01:57:54.459176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-aa5e2e0e-223a-4835-ad13-c78a54742663 req-e350c807-643a-4c49-bbb8-b1496cd30a46 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041498 Apr 09 01:57:54.459822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 205/413] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:54.609999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:54.621496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-506aee84-860c-42dd-a992-aabcefeab111 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1473 microversion: 2.1 time: 0.317432 Apr 09 01:57:54.622374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 209/414] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:54 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:54.725731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:54.726622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:54.739558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.740431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.741500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.742391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.844566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-24ea37c0-45df-492c-a974-5d258c210cdf req-d3566e4e-2591-4fc8-9db7-b1e8a32a905f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b453594-dafd-4c17-b89f-99d0d71a68c8", "name": "network-vif-deleted", "tag": "27a9d1fd-72cd-4f30-ad24-03981fc9fcc1"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:54.847127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:54.847127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:54.865481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-24ea37c0-45df-492c-a974-5d258c210cdf req-d3566e4e-2591-4fc8-9db7-b1e8a32a905f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:54.866987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-24ea37c0-45df-492c-a974-5d258c210cdf req-d3566e4e-2591-4fc8-9db7-b1e8a32a905f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:54.921522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-24ea37c0-45df-492c-a974-5d258c210cdf req-d3566e4e-2591-4fc8-9db7-b1e8a32a905f service nova] Creating event network-vif-deleted:27a9d1fd-72cd-4f30-ad24-03981fc9fcc1 for instance 7b453594-dafd-4c17-b89f-99d0d71a68c8 on hv-cinder-78462 Apr 09 01:57:54.928057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-24ea37c0-45df-492c-a974-5d258c210cdf req-d3566e4e-2591-4fc8-9db7-b1e8a32a905f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087776 Apr 09 01:57:54.929327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 210/415] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:57:55.082744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:55.084303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:55.098643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.099401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.100478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.101116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.135015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:55.151216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d5b7c0c4-cfe5-40ed-b2fe-b1ff4e248126 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.433700 Apr 09 01:57:55.152022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 206/416] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:54 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:55.318168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:55.319360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:55.328563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.329148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.329353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:55.330659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.331162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.345136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-036f12f0-f7c6-4d26-a688-396dd8b24c3d tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.272311 Apr 09 01:57:55.346211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 211/417] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:55 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:55.429184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:55.430654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:55.440905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.441643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.442700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.443292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.542242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-15dde3f4-e8eb-4905-9edd-73a249d94ee3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28441 microversion: 2.20 time: 0.228965 Apr 09 01:57:55.543727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 207/418] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:55 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28441 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:57:55.643443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:55.644371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:55.654309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.655242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.655926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.656541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.725548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:55.737955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-71fda2b8-5fc7-45f1-92f8-958578e76da6 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1513 microversion: 2.1 time: 0.317307 Apr 09 01:57:55.739427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 212/419] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:55 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:55.774238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:55.774761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:55.775279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lazy-loading 'fault' on Instance uuid 7b453594-dafd-4c17-b89f-99d0d71a68c8 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:55.866322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:55.885123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b703b923-1fc1-4485-96be-522e32058fdc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 200 len: 1309 microversion: 2.1 time: 0.246693 Apr 09 01:57:55.900889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 208/420] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:55 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:56.174675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:56.176091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:56.185758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.186265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.187148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.187639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.376660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:56.377336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:56.385806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.386313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.387375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.388150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.792115 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:56.808917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-66c75e4f-1b2b-4b89-a4ff-4dd24a15fda9 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.638041 Apr 09 01:57:56.809957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 213/421] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:56 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:56.819466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:56.821532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:56.838128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.839093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.840669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.841496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.969258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:56.979270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0412fb9c-3195-4065-991e-1c703648af2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.607856 Apr 09 01:57:56.979929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 209/422] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:56 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:56.985392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:56.986616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:56.995267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.995777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:56.996735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:56.997156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.044169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0e8f8556-74cc-4170-b2c4-e173bf01aadb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28494 microversion: 2.20 time: 0.231685 Apr 09 01:57:57.053499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 214/423] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:56 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28494 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:57:57.067043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:57.067809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 7b453594-dafd-4c17-b89f-99d0d71a68c8] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:57.076981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:57.077480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.078454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:57.078951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.138550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] HTTP exception thrown: Instance 7b453594-dafd-4c17-b89f-99d0d71a68c8 could not be found. Apr 09 01:57:57.139254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Returning 404 to user: Instance 7b453594-dafd-4c17-b89f-99d0d71a68c8 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:57:57.140227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ffd9ca4f-f62d-4271-8d60-8f59b4755e12 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8" status: 404 len: 111 microversion: 2.1 time: 0.084734 Apr 09 01:57:57.140838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 215/424] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:57 2021] GET /compute/v2.1/servers/7b453594-dafd-4c17-b89f-99d0d71a68c8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:57:57.353163 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:57.373952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a62e8732-8b21-4296-a320-ad1d3d2f5a75 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1471 microversion: 2.1 time: 0.392181 Apr 09 01:57:57.375159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 210/425] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:56 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:57.631334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3d9a6144-8d2b-4d61-8c8e-b249c646f504 req-a082017d-4922-4208-aa1f-a2265497b18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de4fa5-7bb3-4e7f-b497-63db8ea11129", "name": "network-vif-deleted", "tag": "049cb625-5ff0-4774-8879-28ddd907f300"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:57.633177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:57:57.633177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:57:57.643197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3d9a6144-8d2b-4d61-8c8e-b249c646f504 req-a082017d-4922-4208-aa1f-a2265497b18d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:57.643738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3d9a6144-8d2b-4d61-8c8e-b249c646f504 req-a082017d-4922-4208-aa1f-a2265497b18d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.662797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3d9a6144-8d2b-4d61-8c8e-b249c646f504 req-a082017d-4922-4208-aa1f-a2265497b18d service nova] Creating event network-vif-deleted:049cb625-5ff0-4774-8879-28ddd907f300 for instance e5de4fa5-7bb3-4e7f-b497-63db8ea11129 on hv-cinder-78462 Apr 09 01:57:57.668249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3d9a6144-8d2b-4d61-8c8e-b249c646f504 req-a082017d-4922-4208-aa1f-a2265497b18d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041502 Apr 09 01:57:57.668921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 216/426] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:57:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:57:57.838148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:57.839232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:57.854212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:57.855163 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.856685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:57.857566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:57.999611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:58.000719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:58.010467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.010967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.011842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.012376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.537565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:58.549634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e2dda63d-f9f4-42ad-a928-f45d7af0c031 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.554087 Apr 09 01:57:58.550373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 217/427] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:57 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:58.553028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:58.555801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:57:58.557084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:58.565282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-593c0fef-a7ff-4082-be64-471c975b8c1b tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.734791 Apr 09 01:57:58.566407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 211/428] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:57 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:58.566689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.567249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.568231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.568774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.578620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:58.579490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:58.595855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.596833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.598362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.599287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.706763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:58.707257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:58.707787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid e5de4fa5-7bb3-4e7f-b497-63db8ea11129 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:57:58.797021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:58.806938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d0f103e0-aaa9-4ae2-b8ed-8dc8fb14c1ca tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1307 microversion: 2.1 time: 0.235543 Apr 09 01:57:58.807677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 212/429] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:58 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:57:59.576741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:59.577522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:59.587884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:59.588438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:59.589306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:59.589800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:59.873522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:57:59.894757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e2f480dd-96eb-40ac-9243-67e0dceceb07 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.321266 Apr 09 01:57:59.895927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 213/430] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:59 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:57:59.905554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:57:59.906819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:57:59.924252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:59.925209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:57:59.926827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:57:59.927758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:00.226180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:00.235807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-46e9398c-668f-4821-bc62-570b7ecf8e4c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.338189 Apr 09 01:58:00.237078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 214/431] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:57:59 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:00.242136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:00.242816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:00.251258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:00.251867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:00.252840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:00.253376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:00.330899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:00.331407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:00.331942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid e5de4fa5-7bb3-4e7f-b497-63db8ea11129 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:00.443321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:00.452882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6b548d5b-965d-46e6-a9b0-22638341a974 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 200 len: 1307 microversion: 2.1 time: 0.214612 Apr 09 01:58:00.453532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 215/432] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:00 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:00.690519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3f6d421a-bb94-4e5f-b7d2-aaafa4b51dfb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28608 microversion: 2.20 time: 2.138495 Apr 09 01:58:00.691201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 218/433] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:57:58 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28608 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:00.915374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:00.916160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:00.925110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:00.925619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:00.926484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:00.926978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.172575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:01.193487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0e54eb26-8839-43e8-965b-db84c1037ee7 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.282418 Apr 09 01:58:01.194703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 216/434] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:00 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:01.256353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:01.257504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:01.266903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.267946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.268875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.269390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.483858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:01.485210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: e5de4fa5-7bb3-4e7f-b497-63db8ea11129] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:01.497507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:01.499007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.502164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.502164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.502164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.509107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3485340e-4b3f-4ccd-b350-05c1716c19a7 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.257498 Apr 09 01:58:01.509893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 219/435] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:01 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:01.558738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Instance e5de4fa5-7bb3-4e7f-b497-63db8ea11129 could not be found. Apr 09 01:58:01.559414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 404 to user: Instance e5de4fa5-7bb3-4e7f-b497-63db8ea11129 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:01.560392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b313a9a4-f5a3-43f8-a3b1-354270469897 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129" status: 404 len: 111 microversion: 2.1 time: 0.085616 Apr 09 01:58:01.561043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 217/436] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:01 2021] GET /compute/v2.1/servers/e5de4fa5-7bb3-4e7f-b497-63db8ea11129 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:58:01.704176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:01.705864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:01.715284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.715884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.717474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:01.718329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:01.866554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ccee11a7-f07b-4232-a4af-4d267cbb769d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28608 microversion: 2.20 time: 0.165873 Apr 09 01:58:01.868086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 220/437] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:01 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28608 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:02.223387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:02.224025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:02.233629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.234245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.235300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.235879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.538331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:02.539421 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:02.549749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.550523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.551700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.551924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:02.552584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.563130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bfef8a7e-2506-406a-993a-84b5bb5d0105 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.344486 Apr 09 01:58:02.564808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 218/438] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:02 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:02.787063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:02.804354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4968290c-0358-40e4-9c60-d41743d84e1e tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.270860 Apr 09 01:58:02.805809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 221/439] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:02 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:02.881564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:02.883276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:02.896869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:02.897773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:02.904031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.905170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.906850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.907829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.909667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.910460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.911810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:02.912546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:02.995317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:03.101241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a0e65232-57b1-4d24-9b66-619a3b8a3487 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28608 microversion: 2.20 time: 0.223625 Apr 09 01:58:03.106911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 219/440] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:02 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28608 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:03.112804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-ee71c167-9561-4d0c-bb3d-1b6e4115485c req-fc9988fc-7862-4a33-81f2-4ae999e90b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755a60f-d086-457a-be62-04cff72a943e", "name": "network-vif-plugged", "status": "completed", "tag": "9be3ee1c-cebd-42af-838e-59ecd8031e82"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:03.114837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:03.114837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:03.124982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ee71c167-9561-4d0c-bb3d-1b6e4115485c req-fc9988fc-7862-4a33-81f2-4ae999e90b24 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.125643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ee71c167-9561-4d0c-bb3d-1b6e4115485c req-fc9988fc-7862-4a33-81f2-4ae999e90b24 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.159402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-ee71c167-9561-4d0c-bb3d-1b6e4115485c req-fc9988fc-7862-4a33-81f2-4ae999e90b24 service nova] Creating event network-vif-plugged:9be3ee1c-cebd-42af-838e-59ecd8031e82 for instance 6755a60f-d086-457a-be62-04cff72a943e on hv-cinder-78462 Apr 09 01:58:03.170208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-ee71c167-9561-4d0c-bb3d-1b6e4115485c req-fc9988fc-7862-4a33-81f2-4ae999e90b24 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064562 Apr 09 01:58:03.171448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 220/441] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:03.206687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bbb69224-d294-48b1-b015-fcfa701b0588 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 204 len: 0 microversion: 2.1 time: 0.313688 Apr 09 01:58:03.207330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 222/442] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:02 2021] DELETE /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:03.217525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:03.218797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:03.229402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.229925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.233308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.233308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.552042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:03.564966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8d6f40f0-bc0b-408b-b7f7-55d3113acf3c tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 0.352473 Apr 09 01:58:03.565604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 221/443] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:03 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:03.591256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:03.592156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:03.601674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.602188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.603063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.603558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.824665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:03.825714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:03.835616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.836173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.837091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:03.837591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:03.901844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:03.913580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a765ccef-94fc-41b6-977b-2670fb68667f tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.332220 Apr 09 01:58:03.914798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 223/444] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:03 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:04.096847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:04.106878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a44e75bc-6607-4999-bfc8-5fbfc5156eb1 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.286716 Apr 09 01:58:04.107541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 222/445] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:03 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:04.116588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:04.117804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:04.126469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.127076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:04.128048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.128529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:04.584675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:04.585517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:04.595102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.596450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:04.597587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.598245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:04.813001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:04.823185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1f9a3d27-cafe-499e-a434-f3ae3a229115 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 0.242875 Apr 09 01:58:04.823562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 223/446] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:04 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:04.933993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:04.934726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:04.943732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.944336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:04.945257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:04.945809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:05.162530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:05.173046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d2436441-4ed3-4170-a80c-cf75e0426af0 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.243509 Apr 09 01:58:05.174199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 224/447] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:04 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:05.179193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:05.179870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:05.190432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:05.190942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:05.191811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:05.192363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:05.398099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:05.407369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2799da04-3419-4447-b185-c45fc923321d tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.232014 Apr 09 01:58:05.408562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 225/448] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:05 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:05.842439 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:05.843184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:05.853652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:05.854267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:05.855200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:05.855814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:06.086200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:06.095485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e433ca0b-68ff-44b3-8bbd-aeabaf813059 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 0.257058 Apr 09 01:58:06.096196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 226/449] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:05 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:06.195860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:06.196561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:06.204890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:06.205403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:06.206282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:06.206780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:06.419288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:06.438575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0a26ab04-7fd8-48fa-a4d1-87b8cdf5332c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1568 microversion: 2.1 time: 0.246363 Apr 09 01:58:06.440303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 227/450] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:06 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:06.449926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:06.451208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:06.464432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:06.464934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:06.465792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:06.466279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:06.643157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8274eeb3-d047-4757-b426-8fee2786fe57 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28608 microversion: 2.20 time: 2.530019 Apr 09 01:58:06.645393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 224/451] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:04 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28608 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:06.704316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:06.720439 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5dbf5800-8abb-4d8b-8d03-7aa9e4c807d8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1315 microversion: 2.1 time: 0.278020 Apr 09 01:58:06.721550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 228/452] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:06 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:06.946440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1835541259", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "d27784ad-10c3-40e4-be97-c8934da1309f"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:07.081655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] validate_networks() for [('d27784ad-10c3-40e4-be97-c8934da1309f', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 01:58:07.116281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:07.117146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:07.126107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.127324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.128280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.128818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.446875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:07.461735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4752bf0f-98d6-448f-a0a2-79cff1c5453a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 0.350384 Apr 09 01:58:07.462433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 229/453] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:07 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:07.470027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:07.471794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:07.483859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.484582 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.485745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.486603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.837388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 01:58:07.838137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 01:58:07.838902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 01:58:07.839676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 01:58:07.840586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 01:58:07.870103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.870909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.872587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.873489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.907636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:07.916708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Getting quotas for project f34d1a60aadb4f3dab9ef86891796029. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:58:07.918803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-584648e1-e72c-415a-bdc4-a2d93f0b78bd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1548 microversion: 2.1 time: 0.454796 Apr 09 01:58:07.919952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 230/454] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:07 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1548 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:07.932083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:07.932428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Getting quotas for user 2d506e7be46042138f6199fbf9329f5d and project f34d1a60aadb4f3dab9ef86891796029. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:58:07.932599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:07.939920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.939920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.939920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:07.939920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:07.941302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 01:58:07.944251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 01:58:08.002168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a2c207e0-2162-42b0-8077-fb6f6ba8e354 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064876 Apr 09 01:58:08.003167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 225/455] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 01:58:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 01:58:08.008198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.008871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.019326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.019824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.020717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.021226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.105919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-dc3472cc-76c6-4ca4-bbd2-765fd47161e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 28608 microversion: 2.20 time: 0.184436 Apr 09 01:58:08.107730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 231/456] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:07 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 28608 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:08.113929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.114393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.123606 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.124364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.125109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.125611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.317751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:08.347940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-03d873ce-aef5-4098-a9e5-e693dfe3863c tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1465 microversion: 2.1 time: 0.343082 Apr 09 01:58:08.348834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] HTTP exception thrown: Cannot 'detach_volume' instance e47fda47-7dce-41c1-a042-ebcab29da95d while it is in vm_state rescued Apr 09 01:58:08.350139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Returning 409 to user: Cannot 'detach_volume' instance e47fda47-7dce-41c1-a042-ebcab29da95d while it is in vm_state rescued {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:08.351473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 226/457] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:08 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1465 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:08.352147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-098f3f6d-5a36-40f0-ad36-eca976559849 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments/da77d708-0901-43f3-97bf-56033128dcf8" status: 409 len: 152 microversion: 2.1 time: 0.243682 Apr 09 01:58:08.353804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 232/458] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:58:08 2021] DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments/da77d708-0901-43f3-97bf-56033128dcf8 => generated 152 bytes in 246 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 09 01:58:08.370014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:08.370625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.371697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-937827e0-1e11-42e4-9479-f7f192b1a42d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.373757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-937827e0-1e11-42e4-9479-f7f192b1a42d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.386398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.387093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.388321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.388980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.573918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-937827e0-1e11-42e4-9479-f7f192b1a42d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:08.602581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-937827e0-1e11-42e4-9479-f7f192b1a42d tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1219 microversion: 2.1 time: 0.236992 Apr 09 01:58:08.602581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 227/459] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:08 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:08.602581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.603166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.606123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2b6ebc2c-6f70-4723-aebc-ba26bbd10083 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action" status: 202 len: 0 microversion: 2.1 time: 0.240920 Apr 09 01:58:08.607592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 233/460] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:58:08 2021] POST /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:08.616111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.617497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.625069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.625841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.627874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.628087 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.628426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.628832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.629297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.629799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.708496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:08.915465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0c35f40f-30f3-4b82-b407-34acd21e286f tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "DELETE /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 204 len: 0 microversion: 2.1 time: 0.304703 Apr 09 01:58:08.916776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 234/461] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:08 2021] DELETE /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:08.929296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:08.931108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:08.949037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.950343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:08.952146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:08.953082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:09.303829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:09.316079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c011eed4-df99-4c5a-97bf-111a43224a69 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 0.722456 Apr 09 01:58:09.323648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 228/462] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:08 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:09.323648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:09.323648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:09.334167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:09.334686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:09.335569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:09.336118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:09.801345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:09.822590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2a9ddaf4-9a39-42bd-bb78-75d55fbc00d9 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1556 microversion: 2.1 time: 0.903410 Apr 09 01:58:09.824732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 235/463] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:08 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1556 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:09.836762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:09.840196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:09.858861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:09.860325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:09.862736 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:09.864223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.035107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:10.055243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2086bbed-881f-4b28-8322-6a2c59e67ff8 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1471 microversion: 2.1 time: 0.736512 Apr 09 01:58:10.056748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 229/464] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:09 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1471 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:10.068107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:10.069785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:10.085877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.087222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.089378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.090576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.158898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-71060fad-905e-4927-b5a2-6cbdf7217f1f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 29969 microversion: 2.20 time: 0.330587 Apr 09 01:58:10.161343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 236/465] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:09 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 29969 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:10.350326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:10.351176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:10.363774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.364861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.366459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.367217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.379320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:10.390816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cc8e4cc9-d5af-4746-95a6-8c43c8b8a3c1 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1289 microversion: 2.1 time: 0.331232 Apr 09 01:58:10.392595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 230/466] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:10 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1289 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:10.857427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:10.858945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:10.895673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.898515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:10.899698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:10.901494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.401064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:11.421088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-12e62d33-8a71-4071-943f-0fac825882a8 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1514 microversion: 2.1 time: 1.081225 Apr 09 01:58:11.422298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 237/467] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:10 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1514 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:11.434879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:11.437694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:11.450512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.451255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.452310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.453049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.494821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:11.516386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8359d0aa-5cc3-4d65-aa8c-ecc7dc51b285 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1556 microversion: 2.1 time: 0.667479 Apr 09 01:58:11.518558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 231/468] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:10 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1556 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:11.529341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:11.531410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:11.556458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.560094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.561677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.564340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.835237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-304ab8d9-a5de-4eb9-bf9c-a734190f0f8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 31760 microversion: 2.20 time: 0.313777 Apr 09 01:58:11.837490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 232/469] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:11 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 31760 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:11.846586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-fb53dcf8-64be-4a29-9c0f-ac542e3b4bd6 req-ab70c0a9-f3b6-460a-814e-cbedfc50a8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282be1e9-7f90-445a-bb34-976027a27d72", "name": "network-vif-deleted", "tag": "7415309d-5eb7-43c1-b857-5878d458bc32"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:11.849049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:11.849049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:11.868559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fb53dcf8-64be-4a29-9c0f-ac542e3b4bd6 req-ab70c0a9-f3b6-460a-814e-cbedfc50a8cc service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.869401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-fb53dcf8-64be-4a29-9c0f-ac542e3b4bd6 req-ab70c0a9-f3b6-460a-814e-cbedfc50a8cc service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.947261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-fb53dcf8-64be-4a29-9c0f-ac542e3b4bd6 req-ab70c0a9-f3b6-460a-814e-cbedfc50a8cc service nova] Creating event network-vif-deleted:7415309d-5eb7-43c1-b857-5878d458bc32 for instance 282be1e9-7f90-445a-bb34-976027a27d72 on hv-cinder-78462 Apr 09 01:58:11.959085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-fb53dcf8-64be-4a29-9c0f-ac542e3b4bd6 req-ab70c0a9-f3b6-460a-814e-cbedfc50a8cc service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119834 Apr 09 01:58:11.960769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 233/470] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:11.972970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:11.974756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:11.992978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.994304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:11.996284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:11.997487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.231444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:12.249596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b7d7dd47-864c-4255-9312-c87bbaafd301 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1471 microversion: 2.1 time: 0.824407 Apr 09 01:58:12.251146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 238/471] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:11 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1471 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:12.450757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:12.452357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:12.471167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.472502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.474260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.476911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.653281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.654184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.655289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid 282be1e9-7f90-445a-bb34-976027a27d72 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:12.781632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:12.805050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b2938257-50a4-4200-aeb0-1da0f9b1752c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.841445 Apr 09 01:58:12.806244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 234/472] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:11 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:12.817320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:12.818576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:12.836174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.836731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.839121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.841116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.852423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:12.892029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9f0fc2f8-6ac7-492b-b5bf-d92815fa1422 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 200 len: 1308 microversion: 2.1 time: 0.445239 Apr 09 01:58:12.902021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 239/473] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:12 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:12.925099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:12.927921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:12.945727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.946394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:12.948021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:12.949126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.175860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4c176e54-61b7-4ec3-8b3c-2acce93238a4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 33111 microversion: 2.20 time: 0.271297 Apr 09 01:58:13.178227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 240/474] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:12 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 33111 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:13.279197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:13.280012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:13.290092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.290507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.291374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.291947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.487604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:13.503703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94892444240e4a65b8363928903c8428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7bba559dd0c4915b7d88a224a90d318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:13.510574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-674abcc1-9f3f-4372-8b4f-a2c5829b5f6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1562 microversion: 2.1 time: 0.702801 Apr 09 01:58:13.511228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 235/475] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:12 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1562 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:13.523340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-75d2c7ec-7699-4f1c-95af-7e3075896b12 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 200 len: 1429 microversion: 2.1 time: 0.247752 Apr 09 01:58:13.524661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 241/476] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:13 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 1429 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:13.670111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:13.671273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:13.687964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.689111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.690866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.691932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.824258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:13.824936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:13.839262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.839262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.839262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:13.839262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:13.988960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'services' on Instance uuid e47fda47-7dce-41c1-a042-ebcab29da95d {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:14.074552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:14.084268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b96df644-1cc5-445a-a140-c28ebebef6f2 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.264001 Apr 09 01:58:14.085108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 242/477] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:13 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:14.089966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-15216085-9471-4940-8f9d-944d8d681714 req-f5e95367-d9de-4ee1-8d1c-3aa3e59009b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af6d18c-e2da-4807-92f6-f887e9c70457", "tag": "16052b48-c12f-45a3-977c-55ffe42a244e"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:14.091670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:14.091670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:14.101584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-15216085-9471-4940-8f9d-944d8d681714 req-f5e95367-d9de-4ee1-8d1c-3aa3e59009b9 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.102266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-15216085-9471-4940-8f9d-944d8d681714 req-f5e95367-d9de-4ee1-8d1c-3aa3e59009b9 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.122127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-15216085-9471-4940-8f9d-944d8d681714 req-f5e95367-d9de-4ee1-8d1c-3aa3e59009b9 service nova] Creating event network-changed:16052b48-c12f-45a3-977c-55ffe42a244e for instance 4af6d18c-e2da-4807-92f6-f887e9c70457 on hv-cinder-78462 Apr 09 01:58:14.127554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-15216085-9471-4940-8f9d-944d8d681714 req-f5e95367-d9de-4ee1-8d1c-3aa3e59009b9 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041241 Apr 09 01:58:14.128314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 243/478] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:14.134334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:14.135088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 282be1e9-7f90-445a-bb34-976027a27d72] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:14.144203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.144707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.145772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.146065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.179167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-04a8629d-22d8-4018-9c03-f1e5863b515a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments/da77d708-0901-43f3-97bf-56033128dcf8" status: 202 len: 0 microversion: 2.1 time: 0.517051 Apr 09 01:58:14.185309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 236/479] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:58:13 2021] DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d/os-volume_attachments/da77d708-0901-43f3-97bf-56033128dcf8 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:14.203175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3f462023-01d6-4a5d-b8b8-5de1fb9b2584 req-d0c1300b-4761-4811-b2b3-07ddf6fd89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755a60f-d086-457a-be62-04cff72a943e", "name": "network-vif-deleted", "tag": "9be3ee1c-cebd-42af-838e-59ecd8031e82"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:14.205644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:14.205644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:14.215504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3f462023-01d6-4a5d-b8b8-5de1fb9b2584 req-d0c1300b-4761-4811-b2b3-07ddf6fd89b4 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.215954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3f462023-01d6-4a5d-b8b8-5de1fb9b2584 req-d0c1300b-4761-4811-b2b3-07ddf6fd89b4 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.227883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Instance 282be1e9-7f90-445a-bb34-976027a27d72 could not be found. Apr 09 01:58:14.228598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 404 to user: Instance 282be1e9-7f90-445a-bb34-976027a27d72 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:14.229523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1c3f1639-21fb-4c0f-a532-5fd053345e49 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72" status: 404 len: 111 microversion: 2.1 time: 0.100092 Apr 09 01:58:14.230164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 244/480] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:14 2021] GET /compute/v2.1/servers/282be1e9-7f90-445a-bb34-976027a27d72 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:58:14.240136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3f462023-01d6-4a5d-b8b8-5de1fb9b2584 req-d0c1300b-4761-4811-b2b3-07ddf6fd89b4 service nova] Creating event network-vif-deleted:9be3ee1c-cebd-42af-838e-59ecd8031e82 for instance 6755a60f-d086-457a-be62-04cff72a943e on hv-cinder-78462 Apr 09 01:58:14.247759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:14.248841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:14.253367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3f462023-01d6-4a5d-b8b8-5de1fb9b2584 req-d0c1300b-4761-4811-b2b3-07ddf6fd89b4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067440 Apr 09 01:58:14.254041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 237/481] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:14.264666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:14.265595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:14.274748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.275255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.276142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.276629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.276884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.277697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.278868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.280005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.375023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:14.530682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0a46f913-b5e3-4929-8b03-88d9540b0b8c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 34114 microversion: 2.20 time: 0.299110 Apr 09 01:58:14.532023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 245/482] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:14 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 34114 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:14.554318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:14.555419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] [instance: 6755a60f-d086-457a-be62-04cff72a943e] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:14.565033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.565829 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.566872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.567531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.576685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5335589a-8da0-4acc-95a8-ba51cf9b628e tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 204 len: 0 microversion: 2.1 time: 0.320323 Apr 09 01:58:14.578105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 238/483] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:14 2021] DELETE /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:14.596041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:14.597523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:14.616807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.617726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.619353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:14.620308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:14.628281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] HTTP exception thrown: Instance 6755a60f-d086-457a-be62-04cff72a943e could not be found. Apr 09 01:58:14.628943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] Returning 404 to user: Instance 6755a60f-d086-457a-be62-04cff72a943e could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:14.630078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ce8a747f-8858-4c3b-848a-def7d7225397 tempest-VolumesNegativeTest-1029758535 tempest-VolumesNegativeTest-1029758535-project] 10.222.0.38 "GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e" status: 404 len: 111 microversion: 2.1 time: 0.080429 Apr 09 01:58:14.631162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 246/484] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:14 2021] GET /compute/v2.1/servers/6755a60f-d086-457a-be62-04cff72a943e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 01:58:14.938515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:14.959180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ade409ca-6477-4d72-b469-5dafc9b8b134 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1514 microversion: 2.1 time: 0.374368 Apr 09 01:58:14.961024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 239/485] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:14 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:15.107138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:15.108636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:15.122567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:15.123282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:15.124603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:15.125377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:15.419067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:15.436212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b01728d9-9732-492c-b4b9-406dd426aa4e tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.336652 Apr 09 01:58:15.448045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 247/486] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:15 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:15.554464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:15.556046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:15.566540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:15.567186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:15.569232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:15.569859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:15.741616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db878be6-39e3-4a7c-9476-e8d18c1dfbee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 34862 microversion: 2.20 time: 0.197604 Apr 09 01:58:15.742350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 240/487] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:15 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 34862 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:15.995723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:15.996856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:16.014536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.015597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:16.017077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.018140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:16.252038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:16.263276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ead3d3b1-17c2-425a-bfd9-826396ff2dd3 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1514 microversion: 2.1 time: 0.276001 Apr 09 01:58:16.264099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 248/488] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:15 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:16.463458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:16.464200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:16.474218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.474717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:16.475563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.476067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:16.800877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:16.802340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:16.804539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:16.825414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c637a5dd-54ee-41b4-8441-0c31d65ad208 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.365220 Apr 09 01:58:16.837551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.840223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:16.842035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:16.843409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 241/489] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:16 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:16.843672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:17.074272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3b613ffa-410c-4184-a533-76dab01027ef tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 36115 microversion: 2.20 time: 0.316717 Apr 09 01:58:17.076258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 249/490] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:16 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 36115 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:58:17.290201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:17.290729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:17.307352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:17.308276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:17.309837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:17.310678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:17.587104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:17.598586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db92532b-e8e6-4ac3-894b-cdc1f4ea0a21 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1514 microversion: 2.1 time: 0.317792 Apr 09 01:58:17.608076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 242/491] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:17 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:17.865511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:17.866914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:17.881496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:17.882454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:17.883772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:17.884518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.088516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:18.089671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:18.108992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.109508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.110401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.111432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.230177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:18.246310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-69b19f18-551a-40c2-b487-bce3d0071de4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.385776 Apr 09 01:58:18.247159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 250/492] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:17 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:18.318647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e803f1fa-34d4-412e-becf-53aa5a5e2843 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 37769 microversion: 2.20 time: 0.232757 Apr 09 01:58:18.326685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 243/493] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:18 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 37769 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:18.383941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-591b95b9-9e10-463a-9508-1ca9c7eb1e34 req-5c1cb41f-803f-4185-aa6f-82533d01ab79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864d010f-f853-4864-9a69-92cf573e9790", "name": "network-vif-deleted", "tag": "65fa996e-751e-49c6-9116-71a0d1bf7369"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:18.385842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:18.385842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:18.412951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-591b95b9-9e10-463a-9508-1ca9c7eb1e34 req-5c1cb41f-803f-4185-aa6f-82533d01ab79 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.414035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-591b95b9-9e10-463a-9508-1ca9c7eb1e34 req-5c1cb41f-803f-4185-aa6f-82533d01ab79 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.455291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-591b95b9-9e10-463a-9508-1ca9c7eb1e34 req-5c1cb41f-803f-4185-aa6f-82533d01ab79 service nova] Creating event network-vif-deleted:65fa996e-751e-49c6-9116-71a0d1bf7369 for instance 864d010f-f853-4864-9a69-92cf573e9790 on hv-cinder-78462 Apr 09 01:58:18.466479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-591b95b9-9e10-463a-9508-1ca9c7eb1e34 req-5c1cb41f-803f-4185-aa6f-82533d01ab79 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086682 Apr 09 01:58:18.467744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 251/494] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:18.625531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:18.627411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:18.647828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.649073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.650644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.651527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.754585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:18.755090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:18.755611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid 864d010f-f853-4864-9a69-92cf573e9790 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:18.825499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:18.837622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d68a66a5-273f-4ce0-8821-a8b4654f0cae tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 200 len: 1307 microversion: 2.1 time: 0.223307 Apr 09 01:58:18.838452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 244/495] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:18 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:19.276168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:19.276990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:19.290324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.291125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.292570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.293387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.340357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:19.342034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:19.356464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.357325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.359035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.359844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.539408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ba39ae64-9259-48f8-b499-7179fc35fb31 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 38160 microversion: 2.20 time: 0.205774 Apr 09 01:58:19.540760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 245/496] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:19 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 38160 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:58:19.583823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:19.594083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bdfe355e-3c95-420b-a2d2-2ad2dd93ff20 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.322807 Apr 09 01:58:19.594726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 252/497] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:19 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:19.729922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:19.730570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:19.741745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.742257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.743125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.743608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.842053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:19.866056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:19.868754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 864d010f-f853-4864-9a69-92cf573e9790] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:19.895510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.896743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:19.898564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:19.899676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.017328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Instance 864d010f-f853-4864-9a69-92cf573e9790 could not be found. Apr 09 01:58:20.018111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 404 to user: Instance 864d010f-f853-4864-9a69-92cf573e9790 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:20.019039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-69859f1d-e8e5-4577-a35b-211998ae9f4a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790" status: 404 len: 111 microversion: 2.1 time: 0.164112 Apr 09 01:58:20.022333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 253/498] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:19 2021] GET /compute/v2.1/servers/864d010f-f853-4864-9a69-92cf573e9790 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:58:20.081842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-44721ede-ae13-47f2-9bde-4184922ecc2c tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "DELETE /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 204 len: 0 microversion: 2.1 time: 0.356316 Apr 09 01:58:20.082764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 246/499] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:19 2021] DELETE /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:20.092970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:20.094124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:20.108520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.109378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.111379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.112275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.381727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:20.391160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e8729d73-b188-4297-ba7b-5d95a06acdbd tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1508 microversion: 2.1 time: 0.303085 Apr 09 01:58:20.392504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 254/500] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:20 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:20.554369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:20.555565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:20.564375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.564874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.565802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.566287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.618728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:20.619790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:20.629010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.629620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.630561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:20.631130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:20.705185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8146977d-2858-4280-9c8d-d5f7771db608 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 38160 microversion: 2.20 time: 0.154693 Apr 09 01:58:20.707238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 247/501] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:20 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 38160 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:20.839691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:20.849103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-80b887ed-0b47-478f-8928-de3d0e21f826 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.235035 Apr 09 01:58:20.850054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 255/502] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:20 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:21.021448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-b8b75799-9f3e-4d25-af19-5f0d5fb95d42 req-c40a14e3-a4ff-4361-b85b-4ed9ab0715d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af6d18c-e2da-4807-92f6-f887e9c70457", "name": "network-vif-plugged", "status": "completed", "tag": "16052b48-c12f-45a3-977c-55ffe42a244e"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:21.023801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:21.023801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:21.034804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b8b75799-9f3e-4d25-af19-5f0d5fb95d42 req-c40a14e3-a4ff-4361-b85b-4ed9ab0715d2 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.035444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b8b75799-9f3e-4d25-af19-5f0d5fb95d42 req-c40a14e3-a4ff-4361-b85b-4ed9ab0715d2 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.055708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-b8b75799-9f3e-4d25-af19-5f0d5fb95d42 req-c40a14e3-a4ff-4361-b85b-4ed9ab0715d2 service nova] Creating event network-vif-plugged:16052b48-c12f-45a3-977c-55ffe42a244e for instance 4af6d18c-e2da-4807-92f6-f887e9c70457 on hv-cinder-78462 Apr 09 01:58:21.065388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-b8b75799-9f3e-4d25-af19-5f0d5fb95d42 req-c40a14e3-a4ff-4361-b85b-4ed9ab0715d2 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048634 Apr 09 01:58:21.066418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 248/503] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:21.353197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:21.353746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:21.364211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.364983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.366130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.366631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.412025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:21.412741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:21.422220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.422733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.424469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.424971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.471654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:21.618984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a867af3f-aa2d-4670-ae3a-94eed5e2e822 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "DELETE /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 204 len: 0 microversion: 2.1 time: 0.269190 Apr 09 01:58:21.619905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 256/504] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:21 2021] DELETE /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 01:58:21.635802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:21.637342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:21.653471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.654348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.657352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.658732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.733884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:21.750795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ae2b5dd9-ac07-42f1-bd71-17d27cd068c4 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1508 microversion: 2.1 time: 0.343640 Apr 09 01:58:21.752625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 249/505] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:21 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:21.762647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:21.764416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:21.779123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.780046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.781594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:21.783381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:21.954346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:21.964200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-75d333e6-13d3-438f-a3f8-d96c16765fd4 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1515 microversion: 2.1 time: 0.337633 Apr 09 01:58:21.964857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 257/506] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:21 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:21.992646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:21.993682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:21.994228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7f159e6a-cab3-4a44-a84b-752758f94206 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 38166 microversion: 2.20 time: 0.239334 Apr 09 01:58:21.995398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 250/507] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:21 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 38166 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:22.009088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:22.009992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:22.011528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:22.012422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:22.572782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:22.585708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c74423a-6969-4211-8be2-49a331cfabf6 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1319 microversion: 2.1 time: 0.602293 Apr 09 01:58:22.586912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 258/508] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:21 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:22.786761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:22.787892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:22.807282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:22.808191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:22.809672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:22.810535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.002207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:23.003260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:23.028199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.029176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.030854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.031799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.105921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:23.120678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4e37fed2-d380-455d-8ed3-044d0b941e44 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1508 microversion: 2.1 time: 0.343856 Apr 09 01:58:23.126717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 251/509] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:22 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:23.141093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:23.143657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:23.164134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.164627 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.166642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.168237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.395422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7e1ef42a-3e18-461c-bd13-95259a416c12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 200 len: 38303 microversion: 2.20 time: 0.265385 Apr 09 01:58:23.397636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 252/510] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:23 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 38303 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:23.418387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:23.420084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:23.436558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.437371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.439417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.440299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.458222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:23.468674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-417f896c-a908-4ad8-abc7-c59b0ec10d54 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1515 microversion: 2.1 time: 0.476059 Apr 09 01:58:23.469632 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 259/511] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:22 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:23.559511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9926f8a2-e347-45e9-857e-424fb515b121 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/ips" status: 200 len: 151 microversion: 2.20 time: 0.151539 Apr 09 01:58:23.560465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 253/512] 10.222.0.38 () {60 vars in 1279 bytes} [Fri Apr 9 01:58:23 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/ips => generated 151 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:58:23.618312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:23.619581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:23.628147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.629033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.631981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.632791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.870602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:23.884962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5aae4cbe-df1d-475d-be80-e1455a2c5ed9 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1508 microversion: 2.1 time: 0.270935 Apr 09 01:58:23.885613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 260/513] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:23 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:23.920311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a657b3c7-bc03-4657-ad2b-53b8242817a9", "device": "/dev/sdb"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:23.921995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:23.945397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.946383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:23.947856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:23.948751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:24.158110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:24.158827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:24.172688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:24.173883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:24.174782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:24.175301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:24.680623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ec8425fd-05cf-4f92-87c9-b1c7045591bd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "POST /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765394 Apr 09 01:58:24.686484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 254/514] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 01:58:23 2021] POST /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:24.710065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:24.713929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:24.718013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:24.728647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-82c9d413-fe48-4e3d-83e0-e3b2b1c4bc40 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1508 microversion: 2.1 time: 0.576513 Apr 09 01:58:24.729311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 261/515] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:24 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:24.746849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:24.747956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:24.751253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:24.753528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.358133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:25.371317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8494cbf7-3209-4c90-9aea-5c1d74f35246 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1515 microversion: 2.1 time: 0.687766 Apr 09 01:58:25.372301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 255/516] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:24 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1515 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:25.423267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-b24f821c-90ea-4cf3-907a-966ed154526a req-1960f0ba-d48c-4ecd-9220-fcc7aa05bf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4de4dd-c73a-4ea9-8271-bc81f850217c", "name": "network-vif-deleted", "tag": "09ce87aa-c7ef-40b2-84ee-1f1b872471fe"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:25.425680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:25.425680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:25.436866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b24f821c-90ea-4cf3-907a-966ed154526a req-1960f0ba-d48c-4ecd-9220-fcc7aa05bf8c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:25.437565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b24f821c-90ea-4cf3-907a-966ed154526a req-1960f0ba-d48c-4ecd-9220-fcc7aa05bf8c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.457159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-b24f821c-90ea-4cf3-907a-966ed154526a req-1960f0ba-d48c-4ecd-9220-fcc7aa05bf8c service nova] Creating event network-vif-deleted:09ce87aa-c7ef-40b2-84ee-1f1b872471fe for instance 6b4de4dd-c73a-4ea9-8271-bc81f850217c on hv-cinder-78462 Apr 09 01:58:25.464167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-b24f821c-90ea-4cf3-907a-966ed154526a req-1960f0ba-d48c-4ecd-9220-fcc7aa05bf8c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045203 Apr 09 01:58:25.465298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 262/517] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:25.747810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:25.748745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:25.762923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:25.763805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.764387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:25.764952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.851320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-28ab0cc4-33fa-460a-b269-26200a1c7d8e req-2afbdd36-947e-4e5a-b715-8c521a64f529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8dfd3c-580f-4c46-a9ee-300b305ca1d1", "name": "network-vif-deleted", "tag": "8d9b252f-f22d-4ce9-b735-5bd12865a4da"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:25.854180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:25.854180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:25.868336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-28ab0cc4-33fa-460a-b269-26200a1c7d8e req-2afbdd36-947e-4e5a-b715-8c521a64f529 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:25.870104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-28ab0cc4-33fa-460a-b269-26200a1c7d8e req-2afbdd36-947e-4e5a-b715-8c521a64f529 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.879766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:25.880376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:25.880893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'fault' on Instance uuid 6b4de4dd-c73a-4ea9-8271-bc81f850217c {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:25.898430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-28ab0cc4-33fa-460a-b269-26200a1c7d8e req-2afbdd36-947e-4e5a-b715-8c521a64f529 service nova] Creating event network-vif-deleted:8d9b252f-f22d-4ce9-b735-5bd12865a4da for instance 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 on hv-cinder-78462 Apr 09 01:58:25.905079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-28ab0cc4-33fa-460a-b269-26200a1c7d8e req-2afbdd36-947e-4e5a-b715-8c521a64f529 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059337 Apr 09 01:58:25.906556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 263/518] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:58:25.980217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:25.990177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b2d225ef-548a-440b-8e79-f46330c43629 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 200 len: 1311 microversion: 2.1 time: 0.246485 Apr 09 01:58:25.995335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 256/519] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:25 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:26.391017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:26.392478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:26.403909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.405015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.405985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.406567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.476806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:26.477887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:26.489022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.489447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.489569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.490168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.490293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.490571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:26.490765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.557672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lazy-loading 'flavor' on Instance uuid 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:26.574971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:26.586210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2ca551cb-d72c-4c61-a5e2-5c6f6d810072 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1308 microversion: 2.1 time: 0.199968 Apr 09 01:58:26.586880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 264/520] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:26 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:26.917773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fab1a97b-bf5f-406e-b65b-9202fc5f5cc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 202 len: 0 microversion: 2.20 time: 0.447480 Apr 09 01:58:26.918483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 257/521] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:58:26 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:26.927672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:26.928373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:26.936346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.936851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:26.937687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:26.938172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.014774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:27.015522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: 6b4de4dd-c73a-4ea9-8271-bc81f850217c] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:27.024926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.025428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.026267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.026754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.080310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] HTTP exception thrown: Instance 6b4de4dd-c73a-4ea9-8271-bc81f850217c could not be found. Apr 09 01:58:27.080972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Returning 404 to user: Instance 6b4de4dd-c73a-4ea9-8271-bc81f850217c could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:27.081873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b870850-2fb1-459c-893e-3a0c166bac59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c" status: 404 len: 111 microversion: 2.1 time: 0.071818 Apr 09 01:58:27.082498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 258/522] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:27 2021] GET /compute/v2.1/servers/6b4de4dd-c73a-4ea9-8271-bc81f850217c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 01:58:27.091665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:27.092229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:27.100964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.101356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.104122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.105453 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.147298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:27.159930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:27.162077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:27.164053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e662657e-c761-41fc-be5d-304f86a5cda3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.240765 Apr 09 01:58:27.165110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 265/523] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:26 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:27.185693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:27.313475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96815424-916a-46c8-86f9-bb49d95315df tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 204 len: 0 microversion: 2.1 time: 0.225390 Apr 09 01:58:27.314136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 259/524] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:27 2021] DELETE /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:58:27.322778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:27.323475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:27.331960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.332520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.333385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.333915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.541623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:27.550887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c4311a00-5ad6-4241-94c9-cd271364de29 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.232144 Apr 09 01:58:27.551533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 266/525] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:27 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:27.605452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:27.606278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:27.614945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.615450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.616335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.616827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.693130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:27.693633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:27.694157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:27.759981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:27.770548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cf54cb30-0aa6-4285-a792-967c375e8646 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1308 microversion: 2.1 time: 0.169680 Apr 09 01:58:27.771212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 260/526] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:27 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:28.196457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:28.197543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:28.206323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.206838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.207689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.208254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.418214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:28.429127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:28.430784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:28.432031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-37f30549-d5dd-450c-a617-d35ed2ab82f0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.240407 Apr 09 01:58:28.432738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 267/527] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:28 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:28.570517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:28.571095 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:28.579057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.579560 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.580434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.580923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.784998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:28.789400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:28.790079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:28.795058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-526e68fe-a3b4-4109-bf70-011b437c9059 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.228435 Apr 09 01:58:28.795786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 261/528] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:28 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:28.798716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.799240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.800126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.800623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.892046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:28.892565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:28.893073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lazy-loading 'fault' on Instance uuid 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:28.962343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957d5db34f84437bbb972ed0ea8d8ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcfc614a87947d4801ef4e95e289ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:28.972234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d1b2330f-7bbc-425a-8dbe-942106c3cb78 tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 200 len: 1308 microversion: 2.1 time: 0.186736 Apr 09 01:58:28.972873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 268/529] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:28 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:29.452673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:29.453315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:29.462633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:29.463307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:29.464441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:29.465026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:29.801339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:29.812108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:29.814313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:29.814512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:29.815142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:29.815595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fb003701-8361-4aa8-bd8e-748c47c6dbfa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.367016 Apr 09 01:58:29.816255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 262/530] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:29 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:29.830284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:29.831220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:29.833026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:29.833958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:29.991790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:29.992497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] [instance: 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:30.000772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:30.001934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:30.002799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:30.003292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:30.061775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] HTTP exception thrown: Instance 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 could not be found. Apr 09 01:58:30.062451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] Returning 404 to user: Instance 5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:30.063368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d82883b9-f4be-4570-85e3-01f5b5388d3a tempest-AttachVolumeNegativeTest-913348937 tempest-AttachVolumeNegativeTest-913348937-project] 10.222.0.38 "GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1" status: 404 len: 111 microversion: 2.1 time: 0.075794 Apr 09 01:58:30.065076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 263/531] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:29 2021] GET /compute/v2.1/servers/5a8dfd3c-580f-4c46-a9ee-300b305ca1d1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 01:58:30.096561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:30.106096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6795de52-5e06-47a6-bf2d-80854db545bf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.296262 Apr 09 01:58:30.106741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 269/532] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:29 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:30.852441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:30.853979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:30.864456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:30.864960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:30.865824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:30.866320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:31.076168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:31.086844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:31.088573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:31.089815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4428953f-50b2-41ce-af61-9405685edcc8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.246764 Apr 09 01:58:31.090412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 264/533] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:30 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:31.127376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:31.127959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:31.136297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:31.136816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:31.137674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:31.138173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:31.378495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:31.388518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e4bc3870-f1d2-4224-a4dc-85872526b020 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.265960 Apr 09 01:58:31.389300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 270/534] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:31 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:32.118225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:32.118958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:32.128198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:32.128696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:32.129551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:32.130044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:32.363038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:32.373935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:32.375737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:32.376953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bf5ae4d0-4b6e-43db-a13d-7611cc994d09 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.263325 Apr 09 01:58:32.377587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 265/535] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:32 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:32.415719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:32.417275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:32.426752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:32.427307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:32.428416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:32.429002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:32.703857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:32.714347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0446dc68-ee79-4bc6-a5cc-a1f919647d6b tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.307277 Apr 09 01:58:32.714911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 271/536] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:32 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:33.398237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:33.398953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:33.408092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:33.408608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:33.409487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:33.409969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:33.701091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:33.714441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:33.716693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:33.718399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bcf4fe89-f157-422d-bf13-b6024612e399 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.324392 Apr 09 01:58:33.719300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 266/537] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:33 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:33.738800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:33.739559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:33.755361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:33.756331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:33.757977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:33.758885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:33.992825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:33.993674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:34.002630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:34.003571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:34.004494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:34.004983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:34.310718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:34.329211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2e2b85eb-1dbc-4fb0-8ecf-44e62bbdd84a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.598416 Apr 09 01:58:34.330686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 272/538] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:33 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:34.341091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lazy-loading 'services' on Instance uuid 7113ca87-3a31-415b-b770-e7f4ce41b0cc {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:34.496618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a834ba22-6e6b-4de2-a5f7-a7b14d305983 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-volume_attachments/60e1fba8-0585-4ab2-9f46-44ed770c439e" status: 202 len: 0 microversion: 2.1 time: 0.515409 Apr 09 01:58:34.497495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 267/539] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:58:33 2021] DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/os-volume_attachments/60e1fba8-0585-4ab2-9f46-44ed770c439e => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 01:58:34.748250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:34.749486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:34.758594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:34.759482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:34.760488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:34.760956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:35.124211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:35.144848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:35.148664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:35.151185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-82b768a6-8e16-475b-b882-0fb9aae82096 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.408274 Apr 09 01:58:35.160063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 273/540] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:34 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:58:35.359722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:35.361855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:35.380361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:35.381300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:35.385052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:35.385052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:35.756261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:35.771949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ff2dadf1-27bc-4b01-ab18-4b6c07570b59 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.422967 Apr 09 01:58:35.773389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 268/541] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:35 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:36.184254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:36.184924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:36.194139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:36.194637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:36.195517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:36.196041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:36.608836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:36.619300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:36.621001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:36.622228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ce4e7714-fcce-407b-87ee-01f964b31b27 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.442757 Apr 09 01:58:36.622851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 274/542] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:36 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:36.805824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:36.807220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:36.821840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:36.822423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:36.823363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:36.823853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:37.078304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:37.093549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-628c08c8-f6d7-46b1-9e8e-2326d1d2590a tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.296948 Apr 09 01:58:37.095100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 269/543] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:36 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:37.643639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:37.644418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:37.652581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:37.653083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:37.653927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:37.654412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:37.858369 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:37.870366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:37.870891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:37.872196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-aabaa94d-4f5c-40d7-bcaa-012b22b2503c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.232880 Apr 09 01:58:37.884195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 275/544] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:37 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:38.118366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:38.119523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:38.129480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:38.129990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:38.130855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:38.131349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:38.382854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:38.392442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9c070493-3037-425d-8ae5-07a21e6ed3be tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.278036 Apr 09 01:58:38.393116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 270/545] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:38 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:38.892200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:38.893002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:38.901936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:38.902653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:38.903466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:38.904077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:39.181961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:39.195340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:39.197097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:39.199581 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-32e7b90d-e64d-4d57-9595-160dcb082829 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.312313 Apr 09 01:58:39.200940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 276/546] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:38 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:39.418432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:39.419089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:39.427192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:39.427700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:39.428576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:39.429069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:39.636147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:39.645228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-400a159c-b920-429e-a041-f191ace986af tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.230810 Apr 09 01:58:39.645868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 271/547] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:39 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:40.221625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:40.222351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:40.231136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:40.231718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:40.232477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:40.233147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:40.460529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:40.477755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:40.479501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:40.480824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d2d857ee-2d19-46d1-978c-07a8a37bd106 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.263953 Apr 09 01:58:40.481461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 277/548] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:40 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:40.664039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:40.664640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:40.673684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:40.674177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:40.675008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:40.675586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:40.885016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:40.896956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-459e7473-8f70-432d-9bbf-93c2768297a2 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.236978 Apr 09 01:58:40.897874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 272/549] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:40 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:41.511282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:41.511942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:41.520470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:41.520978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:41.521824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:41.522312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:41.731516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:41.741912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:41.743608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:41.744911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a8146f6f-68ad-4cf1-9483-0eb076f31184 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.237725 Apr 09 01:58:41.745542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 278/550] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:41 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:41.915825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:41.916962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:41.926801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:41.927647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:41.928543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:41.929041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:42.361384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:42.371150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bb6936ca-5248-44eb-8c70-a1536c857fdf tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1522 microversion: 2.1 time: 0.459890 Apr 09 01:58:42.371796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 273/551] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:41 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:42.560471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-31fd8d5e-195f-4531-823c-819bf0734aaa tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:42.568653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fd8d5e-195f-4531-823c-819bf0734aaa tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:42.569141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fd8d5e-195f-4531-823c-819bf0734aaa tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:42.630518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-31fd8d5e-195f-4531-823c-819bf0734aaa tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Going to try to stop instance {{(pid=99349) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 09 01:58:42.714165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-31fd8d5e-195f-4531-823c-819bf0734aaa tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.157906 Apr 09 01:58:42.715259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 279/552] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:58:42 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:42.724544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:42.725561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:42.742314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:42.743084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:42.744157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:42.744851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:42.767254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:42.767961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:42.776846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:42.777515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:42.778543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:42.779053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:43.328899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:43.334781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:43.339727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f35fed55-b1a2-4b9e-95c1-0c1540caf3ff tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.619587 Apr 09 01:58:43.340430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 274/553] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:42 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:43.348107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:43.351028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d14aff93-aae9-48f9-bf55-a40045a680c3 req-991135fb-3797-4380-86d1-269c115eba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fda47-7dce-41c1-a042-ebcab29da95d", "name": "network-vif-deleted", "tag": "49e02430-bf03-47db-9526-5f7dbe52b57b"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:43.351206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:43.353364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4033d998-4554-4bbc-b68b-42a0736f6f19 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.591654 Apr 09 01:58:43.354417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 280/554] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:42 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:43.354724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:58:43.354724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:58:43.373729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d14aff93-aae9-48f9-bf55-a40045a680c3 req-991135fb-3797-4380-86d1-269c115eba11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:43.374623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d14aff93-aae9-48f9-bf55-a40045a680c3 req-991135fb-3797-4380-86d1-269c115eba11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:43.389766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:43.390462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:43.395637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d14aff93-aae9-48f9-bf55-a40045a680c3 req-991135fb-3797-4380-86d1-269c115eba11 service nova] Creating event network-vif-deleted:49e02430-bf03-47db-9526-5f7dbe52b57b for instance e47fda47-7dce-41c1-a042-ebcab29da95d on hv-cinder-78462 Apr 09 01:58:43.398785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:43.400054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:43.400921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d14aff93-aae9-48f9-bf55-a40045a680c3 req-991135fb-3797-4380-86d1-269c115eba11 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058036 Apr 09 01:58:43.401131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:43.401412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:43.401574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 275/555] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:58:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:58:43.550917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:43.560061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4260732c-dda8-430f-a5a5-b0bafd4ca648 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1480 microversion: 2.1 time: 0.174593 Apr 09 01:58:43.560715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 281/556] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:43 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1480 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:44.360267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:44.361041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:44.369936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.370438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.371303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.371786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.390833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:44.393012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:44.409338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.410269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.411657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.412625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.630744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:44.640107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d51c582a-51bf-4e7b-a936-872393d6846d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.284887 Apr 09 01:58:44.640864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 276/557] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:44 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:44.646185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:44.646847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:44.655257 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.655916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.656655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:44.657211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:44.704431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:44.717339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:44.719073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:44.720508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fd2aa683-89e0-4a07-b1f6-6d9e025b2f17 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.338491 Apr 09 01:58:44.721157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 282/558] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:44 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:44.792615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:44.803217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7b5087ba-e155-43af-8c9f-936bf2105be1 tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1480 microversion: 2.1 time: 0.161237 Apr 09 01:58:44.804167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 277/559] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:44 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1480 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:45.660295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:45.660865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:45.668813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:45.669323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:45.670174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:45.670670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:45.741986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:45.742741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:45.751213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:45.751723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:45.752611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:45.753103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:46.127049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:46.136274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-16f1c124-f4a1-4f09-8c86-55690ec5ea21 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.480668 Apr 09 01:58:46.136927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 283/560] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:45 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:46.142535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:46.143761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:46.159247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:46.160111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:46.161676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:46.162617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:46.228980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:46.239158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:46.240842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:46.242063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-78ed29c1-1b13-4b97-a787-7b71e288949f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.504350 Apr 09 01:58:46.242698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 278/561] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:45 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:58:46.257839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:46.258350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:46.258875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lazy-loading 'fault' on Instance uuid e47fda47-7dce-41c1-a042-ebcab29da95d {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:46.333535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15ae24f513f44e58bc13beedc4ead83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96703e956e034c16ad1cca21be36101a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:46.344401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ed59e510-8f0d-4bbb-9d67-d855e66074cb tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 200 len: 1312 microversion: 2.1 time: 0.206251 Apr 09 01:58:46.345057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 284/562] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:46 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:47.156152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:47.157524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:47.165836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.166307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.167893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.168664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.270659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:47.271965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:47.306995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.307828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.309340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.310133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.697052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:47.706891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cbf41b53-5ecc-4f6b-a923-42a5426159b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.554784 Apr 09 01:58:47.707560 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 279/563] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:47 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:58:47.713092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:47.713998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] [instance: e47fda47-7dce-41c1-a042-ebcab29da95d] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:47.722951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.723641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.724417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:47.724910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:47.775822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:47.783646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] HTTP exception thrown: Instance e47fda47-7dce-41c1-a042-ebcab29da95d could not be found. Apr 09 01:58:47.784486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] Returning 404 to user: Instance e47fda47-7dce-41c1-a042-ebcab29da95d could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:58:47.785411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-52d15e29-8541-4405-99a0-72cd647f5a7e tempest-ServerRescueNegativeTestJSON-1564119801 tempest-ServerRescueNegativeTestJSON-1564119801-project] 10.222.0.38 "GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d" status: 404 len: 111 microversion: 2.1 time: 0.076558 Apr 09 01:58:47.786050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 280/564] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:47 2021] GET /compute/v2.1/servers/e47fda47-7dce-41c1-a042-ebcab29da95d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:58:47.786174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:47.791826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:47.793313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-259174c0-d20e-4699-8640-a68761e86794 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.533920 Apr 09 01:58:47.793992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 285/565] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:47 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:48.737455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:48.740935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:48.768852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:48.770757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:48.772134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:48.772900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:48.818383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:48.819814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:48.833424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:48.834357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:48.835443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:48.836187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:49.164348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:49.175470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:49.177513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:49.179034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eb9863a4-ff18-47f7-9c46-a97d519504e5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.366572 Apr 09 01:58:49.191957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:49.192508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 286/566] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:48 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:49.199204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a74ec23b-0a81-4ebd-a2ec-ecc4457d4ea8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.475841 Apr 09 01:58:49.199860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 281/567] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:48 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:50.201408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:50.202281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:50.220466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:50.221422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:50.228945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.233937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:50.235684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.236433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:50.238900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.242489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:50.243868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.244905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:50.577260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:50.589168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9b7c358b-464c-430a-82f4-21e694385b61 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.374342 Apr 09 01:58:50.595193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 282/568] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:50 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:50.651109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:50.662245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:50.664269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:50.665819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e3bf3677-96ad-49b6-b9a5-aff0037864dc tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.470294 Apr 09 01:58:50.678704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 287/569] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:50 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:50.837371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:50.838098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:50.857906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.858426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:50.859543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:50.860109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:51.120195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lazy-loading 'services' on Instance uuid 4af6d18c-e2da-4807-92f6-f887e9c70457 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:58:51.309923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cddffc78-26a2-4ad3-8313-bd2c04a9972c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457/os-volume_attachments/a657b3c7-bc03-4657-ad2b-53b8242817a9" status: 202 len: 0 microversion: 2.1 time: 0.476365 Apr 09 01:58:51.310769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 283/570] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 01:58:50 2021] DELETE /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457/os-volume_attachments/a657b3c7-bc03-4657-ad2b-53b8242817a9 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:58:51.614709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:51.624689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:51.633550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:51.634056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:51.634911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:51.635396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:51.687647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:51.689186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:51.712740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:51.717343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:51.718526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:51.719210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:52.113567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:52.135689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d2c62c33-7811-44ca-911b-ec2e2439ab59 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.525935 Apr 09 01:58:52.138008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 288/571] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:51 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:52.169443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:52.192444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:52.195401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:52.209590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1b396552-ec50-4067-b3e2-9da011094369 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.527220 Apr 09 01:58:52.210840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 284/572] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:51 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:53.155351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:53.156018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:53.165094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.165609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.166930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.167432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.232144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:53.233014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:53.249520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.250273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.251313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.252558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.529103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:53.539734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5aa5b206-c281-4cf4-bb49-2b4fa46c0c4c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.388687 Apr 09 01:58:53.540399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 289/573] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:53 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:53.544448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:53.555129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:53.556847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:53.558071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-57cc59cb-70e9-4fb3-a7a9-d90b48aaeb26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1743 microversion: 2.20 time: 0.332023 Apr 09 01:58:53.558852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 285/574] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:53 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1743 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:58:53.683752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:53.684334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:53.692569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.693189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.693904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.694464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:53.761916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:58:53.949330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-de0f6f2e-1c79-4f65-9f99-9460877002a4 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 204 len: 0 microversion: 2.1 time: 0.269274 Apr 09 01:58:53.950005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 290/575] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:58:53 2021] DELETE /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 09 01:58:53.965417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:53.967306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:53.998775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:53.999706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.001357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:54.002245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.413119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:54.425319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3b40bf28-e590-4883-b7c3-8eebc6bb68cc tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1514 microversion: 2.1 time: 0.469144 Apr 09 01:58:54.426390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 286/576] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:53 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1514 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:54.559925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:54.560730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:54.569305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:54.569808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.570659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:54.571149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.579026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:54.579867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:54.589845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:54.590625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.592278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:54.593896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:54.888021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:54.901236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d277488d-d18f-4b2b-9658-3080508bbb6a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.345782 Apr 09 01:58:54.904556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 291/577] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:54 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:54.915237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:54.936270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:54.939342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:54.939884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a4486041-73c7-4853-a871-eb5f3e90c7b7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1743 microversion: 2.20 time: 0.365329 Apr 09 01:58:54.940729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 287/578] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:54 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1743 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:55.452042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:55.452755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:55.461385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.461886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:55.462762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.463236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:55.702358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:55.713436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-33b099f2-f373-4991-b244-79a24c5a8464 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1514 microversion: 2.1 time: 0.265683 Apr 09 01:58:55.714252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 292/579] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:55 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:55.923725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:55.924612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:55.933278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.933942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:55.934856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.935353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:55.971612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:55.973175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:55.982122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.982775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:55.984014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:55.985502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:56.263002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:56.271839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:56.287466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:56.290934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-83a25901-445b-420e-b2a0-6d9ef69c5d57 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.371953 Apr 09 01:58:56.293039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:56.295498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-543e671c-ef1e-4316-aa93-dbf6eff9d6f1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1743 microversion: 2.20 time: 0.328794 Apr 09 01:58:56.296010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 293/580] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:55 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1743 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:58:56.296304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 288/581] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:55 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:56.736145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:56.753337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:56.763837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:56.764773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:56.765824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:56.767281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:57.336448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:57.341915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:57.368950 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:57.370022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:57.376551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:57.377535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:58.020733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:58.040804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:58.053562 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:58.054943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5ee76929-d83c-4c0f-946c-1e0f3ec98764 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.733942 Apr 09 01:58:58.055715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 289/582] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:57 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:58:58.076553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:58.077283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:58.095570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:58.096480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:58.097546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:58.105139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:58.112529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:58.121098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c56794ef-bd98-4b14-9316-a4c472d532e3 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1514 microversion: 2.1 time: 1.392585 Apr 09 01:58:58.132338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 294/583] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:56 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1514 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:58.558923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f8147e74-95dc-49da-bd45-679d12a7ebbc tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Action: 'create', calling method: .version_select at 0x7f966de0bc80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-265574784"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:58:58.874570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:58:58.886441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c5b2dca-59fd-446d-8fb0-a68d57898278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1676 microversion: 2.1 time: 0.829727 Apr 09 01:58:58.897890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 290/584] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:58 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1676 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:58:59.075046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:59.076379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:59.095851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:59.096677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:59.097710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:59.098362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:59.709847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f8147e74-95dc-49da-bd45-679d12a7ebbc tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.555386 Apr 09 01:58:59.711450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 295/585] 10.222.0.38 () {60 vars in 1145 bytes} [Fri Apr 9 01:58:58 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1558 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 09 01:58:59.716415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:58:59.717256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:58:59.755205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:59.760886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:58:59.763267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:58:59.778627 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:00.832737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:00.851849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:00.853589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:00.854884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-de18251a-2267-4de4-836d-081113af6dbb tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 1.783928 Apr 09 01:59:00.874123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 291/586] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:58:59 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:00.879720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db377c53-be2c-4422-8161-d1e3ef9db87e tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d2738c8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:00.967669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:00.986073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-101c2d91-5982-4a9d-870f-95ea80ec89cd tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1514 microversion: 2.1 time: 1.273228 Apr 09 01:59:00.987083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 296/587] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:58:59 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1514 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:01.005474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:01.006193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:01.034138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:01.034653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:01.051477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:01.052066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:01.141574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db377c53-be2c-4422-8161-d1e3ef9db87e tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 200 len: 345 microversion: 2.1 time: 0.265614 Apr 09 01:59:01.147571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 292/588] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:59:00 2021] GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 345 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:01.164622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6e904da1-23cf-4c85-9acb-5f520cf0b7fc tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Action: 'create', calling method: .version_select at 0x7f966d497d08>, body: {"snapshot": {"volume_id": "487dd942-0058-4c57-9525-89ec32dd4df7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-421698781"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:01.776653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6e904da1-23cf-4c85-9acb-5f520cf0b7fc tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.615927 Apr 09 01:59:01.777789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 293/589] 10.222.0.38 () {60 vars in 1152 bytes} [Fri Apr 9 01:59:01 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:01.790158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c94af27f-7344-4085-a4e4-98ffef142ecf tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497400>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:01.874273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c94af27f-7344-4085-a4e4-98ffef142ecf tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 200 len: 286 microversion: 2.1 time: 0.088960 Apr 09 01:59:01.875834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 294/590] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:01 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 01:59:01.881710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:01.882711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:01.905685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:01.907161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:01.908321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:01.909042 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:02.333903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:02.348523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-92686247-9d30-4842-b50b-d119452a23db tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1653 microversion: 2.1 time: 1.360260 Apr 09 01:59:02.368441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 297/591] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:00 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1653 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:02.389812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ea07d9b4-ebdd-4359-9d9a-08408f6da87c tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966c9c57b8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:02.472379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ea07d9b4-ebdd-4359-9d9a-08408f6da87c tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.102288 Apr 09 01:59:02.473482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 298/592] 10.222.0.38 () {58 vars in 1130 bytes} [Fri Apr 9 01:59:02 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:02.488312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:02.488982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:02.503424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:02.504347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:02.506396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:02.507114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:02.594643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:02.610123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:02.617406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:02.629650 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f09fbe37-1b37-4003-adeb-e684892f4b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.752213 Apr 09 01:59:02.632032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 295/593] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:01 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:02.648079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-43e262e7-ee9b-428b-b368-1183bcc709f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:02.656889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43e262e7-ee9b-428b-b368-1183bcc709f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:02.657695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43e262e7-ee9b-428b-b368-1183bcc709f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:02.731919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-43e262e7-ee9b-428b-b368-1183bcc709f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Going to try to start instance {{(pid=99348) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 09 01:59:02.821480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-43e262e7-ee9b-428b-b368-1183bcc709f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action" status: 202 len: 0 microversion: 2.1 time: 0.187865 Apr 09 01:59:02.822592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 296/594] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 01:59:02 2021] POST /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:59:02.828310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4fb437e5-4386-4958-ac55-9095f9dbe4bf tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497268>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:02.888753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4fb437e5-4386-4958-ac55-9095f9dbe4bf tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 200 len: 286 microversion: 2.1 time: 0.064625 Apr 09 01:59:02.890455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 297/595] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:02 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:02.896299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-6715b3b6-a211-4ead-b4e0-3c1bae88e396 req-018521b5-373e-406e-870f-e2eeeb1bf2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af6d18c-e2da-4807-92f6-f887e9c70457", "name": "network-vif-deleted", "tag": "16052b48-c12f-45a3-977c-55ffe42a244e"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:02.898677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:59:02.898677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:59:02.914842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6715b3b6-a211-4ead-b4e0-3c1bae88e396 req-018521b5-373e-406e-870f-e2eeeb1bf2b3 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:02.915480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6715b3b6-a211-4ead-b4e0-3c1bae88e396 req-018521b5-373e-406e-870f-e2eeeb1bf2b3 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:02.940444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-6715b3b6-a211-4ead-b4e0-3c1bae88e396 req-018521b5-373e-406e-870f-e2eeeb1bf2b3 service nova] Creating event network-vif-deleted:16052b48-c12f-45a3-977c-55ffe42a244e for instance 4af6d18c-e2da-4807-92f6-f887e9c70457 on hv-cinder-78462 Apr 09 01:59:02.954794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-6715b3b6-a211-4ead-b4e0-3c1bae88e396 req-018521b5-373e-406e-870f-e2eeeb1bf2b3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061128 Apr 09 01:59:02.960062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 298/596] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:02.970401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-afcb618d-0aeb-4e78-a33a-638439ba0b91 req-7f6199af-cb79-4dff-8af8-532d1d528779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "name": "network-vif-plugged", "status": "completed", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:02.975697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:59:02.975697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:59:03.003791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-afcb618d-0aeb-4e78-a33a-638439ba0b91 req-7f6199af-cb79-4dff-8af8-532d1d528779 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:03.004520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-afcb618d-0aeb-4e78-a33a-638439ba0b91 req-7f6199af-cb79-4dff-8af8-532d1d528779 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:03.024466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:03.041404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-afcb618d-0aeb-4e78-a33a-638439ba0b91 req-7f6199af-cb79-4dff-8af8-532d1d528779 service nova] Creating event network-vif-plugged:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 01:59:03.058704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5d773f91-3c28-4be7-848b-db5d382faa70 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1472 microversion: 2.1 time: 0.574626 Apr 09 01:59:03.059970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-afcb618d-0aeb-4e78-a33a-638439ba0b91 req-7f6199af-cb79-4dff-8af8-532d1d528779 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094966 Apr 09 01:59:03.064064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 299/597] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:03.065119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 299/598] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:02 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1472 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:03.083630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:03.085011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:03.094254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:03.094764 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:03.095626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:03.096145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:03.529905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:03.546080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5ee2b0a7-8203-4870-a018-87dd90fcd558 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1662 microversion: 2.1 time: 0.480660 Apr 09 01:59:03.547359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 300/599] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:03 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1662 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:03.652438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:03.653320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:03.667121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:03.668024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:03.670828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:03.672580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:03.903202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-07f8bef1-aeeb-425d-af81-a5be41d1d701 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497488>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:04.020617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-07f8bef1-aeeb-425d-af81-a5be41d1d701 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 200 len: 286 microversion: 2.1 time: 0.121466 Apr 09 01:59:04.021250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 301/600] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:03 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:04.082320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:04.083278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:04.102234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:04.113017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:04.114097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:04.114690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:04.362993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:04.374169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:04.381993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ddbf7cd4-ac68-4cab-81ac-be00d9ded9da tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1304 microversion: 2.1 time: 0.303647 Apr 09 01:59:04.382641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 302/601] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:04 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:04.388338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:04.390287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:04.392270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ad2799d2-c369-477f-9fa8-f770359b2338 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.744097 Apr 09 01:59:04.393066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 300/602] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:03 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:04.564998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:04.566037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:04.589639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:04.590508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:04.591591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:04.592335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:04.937264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:04.958445 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-376255cb-14c7-40b7-9f28-869b06736abc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1662 microversion: 2.1 time: 0.397296 Apr 09 01:59:04.959847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 303/603] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:04 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1662 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:05.033960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3f1f31a1-dd58-47fa-af85-ecb19fe8b3b0 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966c9c5400>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:05.133070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3f1f31a1-dd58-47fa-af85-ecb19fe8b3b0 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 200 len: 287 microversion: 2.1 time: 0.103856 Apr 09 01:59:05.134220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 301/604] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:05 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:05.145601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3f1d4f83-a9fd-48ae-8e76-97c2aa1da0d2 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497620>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:05.308870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3f1d4f83-a9fd-48ae-8e76-97c2aa1da0d2 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "DELETE /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 202 len: 0 microversion: 2.1 time: 0.167284 Apr 09 01:59:05.309767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 304/605] 10.222.0.38 () {58 vars in 1244 bytes} [Fri Apr 9 01:59:05 2021] DELETE /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:59:05.318969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-722c1d98-6c37-4683-91f6-5b1277936232 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966c9c58c8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:05.400906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:05.401665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:05.426003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:05.426520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:05.431298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-722c1d98-6c37-4683-91f6-5b1277936232 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 200 len: 286 microversion: 2.1 time: 0.116544 Apr 09 01:59:05.432217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 302/606] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:05 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:05.437533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:05.439168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:05.440287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:05.441419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:05.470411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:05.471361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:05.476858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:05.477541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:05.707343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:05.709144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:05.712233 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lazy-loading 'fault' on Instance uuid 4af6d18c-e2da-4807-92f6-f887e9c70457 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 01:59:06.262509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d506e7be46042138f6199fbf9329f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34d1a60aadb4f3dab9ef86891796029', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:06.280088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-292978d5-1ef1-4f6c-96e6-53e0bfaf739c tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 200 len: 1309 microversion: 2.1 time: 0.883551 Apr 09 01:59:06.280720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 305/607] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:05 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 1309 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:59:06.295269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:06.296252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:06.309883 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:06.310642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:06.311701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:06.315337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:06.743379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:06.759474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:06.761937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:06.769554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-04fa2945-874d-45d1-9e3e-04a669cb2408 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 1.335793 Apr 09 01:59:06.770466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 303/608] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:05 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:06.780788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8bd7f01f-da73-4e5f-96a9-fc1a725cb73a tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966c906ae8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:06.899434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-8bd7f01f-da73-4e5f-96a9-fc1a725cb73a tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] HTTP exception thrown: Snapshot 53d3a956-3d8a-4725-a8b3-8023e1b61f27 could not be found. Apr 09 01:59:06.900373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8bd7f01f-da73-4e5f-96a9-fc1a725cb73a tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Returning 404 to user: Snapshot 53d3a956-3d8a-4725-a8b3-8023e1b61f27 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:59:06.901765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8bd7f01f-da73-4e5f-96a9-fc1a725cb73a tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27" status: 404 len: 111 microversion: 2.1 time: 0.129645 Apr 09 01:59:06.905583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 304/609] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 01:59:06 2021] GET /compute/v2.1/os-snapshots/53d3a956-3d8a-4725-a8b3-8023e1b61f27 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:59:06.915290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e70152f4-be41-4284-8ab9-a87db2a20599 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966c906378>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:07.130192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:07.146913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a992d382-a331-4a15-ba61-4325a2e1c383 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1662 microversion: 2.1 time: 0.864844 Apr 09 01:59:07.147747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 306/610] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:06 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1662 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:07.179474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e70152f4-be41-4284-8ab9-a87db2a20599 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 202 len: 0 microversion: 2.1 time: 0.268317 Apr 09 01:59:07.180381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 305/611] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 01:59:06 2021] DELETE /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 01:59:07.191259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6671e0cd-a1e4-4660-a039-4e285ffc0f16 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497158>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:07.298625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:07.300508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] [instance: 4af6d18c-e2da-4807-92f6-f887e9c70457] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:07.321480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:07.324630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:07.325765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:07.327110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:07.431228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6671e0cd-a1e4-4660-a039-4e285ffc0f16 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 200 len: 344 microversion: 2.1 time: 0.246002 Apr 09 01:59:07.432164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 307/612] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:59:07 2021] GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 344 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:07.481933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] HTTP exception thrown: Instance 4af6d18c-e2da-4807-92f6-f887e9c70457 could not be found. Apr 09 01:59:07.482761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] Returning 404 to user: Instance 4af6d18c-e2da-4807-92f6-f887e9c70457 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:59:07.483721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3512940b-6a86-4d2c-a439-06d91c830d83 tempest-VolumesSnapshotTestJSON-1349648095 tempest-VolumesSnapshotTestJSON-1349648095-project] 10.222.0.38 "GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457" status: 404 len: 111 microversion: 2.1 time: 0.189199 Apr 09 01:59:07.485440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 306/613] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:07 2021] GET /compute/v2.1/servers/4af6d18c-e2da-4807-92f6-f887e9c70457 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:59:07.792480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:07.793664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:07.809437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:07.813786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:07.815065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:07.816811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:08.176484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:08.182200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:08.262635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:08.271654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:08.277763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:08.285766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:08.468705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:08.486524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:08.495591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:08.498962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-80083997-ce07-4618-bcec-7b9c094e0e7c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.712368 Apr 09 01:59:08.503311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 308/614] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:07 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:08.519052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b60d0e2f-a46a-45dc-85ef-c245aa4ee27b tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d273048>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:08.698994 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b60d0e2f-a46a-45dc-85ef-c245aa4ee27b tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] HTTP exception thrown: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. Apr 09 01:59:08.699452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b60d0e2f-a46a-45dc-85ef-c245aa4ee27b tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Returning 404 to user: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:59:08.700736 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b60d0e2f-a46a-45dc-85ef-c245aa4ee27b tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 404 len: 109 microversion: 2.1 time: 0.195954 Apr 09 01:59:08.701828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 309/615] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:59:08 2021] GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 109 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:59:08.721662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5e1815f7-cc9e-4d6d-9d9d-9ff4a3c42a46 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f966d497ae8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:08.778040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:08.793015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-750602b6-55b5-45bb-803f-471578169ab1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1662 microversion: 2.1 time: 0.629616 Apr 09 01:59:08.793665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 307/616] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:08 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1662 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:08.883100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-5e1815f7-cc9e-4d6d-9d9d-9ff4a3c42a46 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] HTTP exception thrown: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. Apr 09 01:59:08.883770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5e1815f7-cc9e-4d6d-9d9d-9ff4a3c42a46 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Returning 404 to user: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:59:08.884720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5e1815f7-cc9e-4d6d-9d9d-9ff4a3c42a46 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 404 len: 109 microversion: 2.1 time: 0.168597 Apr 09 01:59:08.891483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 310/617] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 01:59:08 2021] DELETE /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 01:59:08.894512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-56805840-bc5f-4019-a987-a794d2210c82 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Calling method '.version_select at 0x7f9671dd4730>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:09.030359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-56805840-bc5f-4019-a987-a794d2210c82 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] HTTP exception thrown: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. Apr 09 01:59:09.031222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-56805840-bc5f-4019-a987-a794d2210c82 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] Returning 404 to user: Volume 487dd942-0058-4c57-9525-89ec32dd4df7 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 01:59:09.032879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-56805840-bc5f-4019-a987-a794d2210c82 tempest-VolumesSnapshotsTestJSON-397434892 tempest-VolumesSnapshotsTestJSON-397434892-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7" status: 404 len: 109 microversion: 2.1 time: 0.142941 Apr 09 01:59:09.033670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 308/618] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 01:59:08 2021] GET /compute/v2.1/os-volumes/487dd942-0058-4c57-9525-89ec32dd4df7 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 01:59:09.522934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:09.523520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:09.557507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:09.558024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:09.558902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:09.559422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:09.812390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:09.813842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:09.842045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:09.842512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:09.843433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:09.843945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:10.051975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:10.068190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:10.070499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:10.075030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-178dcb15-b54c-4121-ba3b-4f684c79e9ce tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.556274 Apr 09 01:59:10.078952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 311/619] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:09 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:10.310643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:10.332264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4e84db96-58fc-497e-83a1-bdc310085331 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1666 microversion: 2.1 time: 0.513861 Apr 09 01:59:10.333237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 309/620] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:09 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1666 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:11.100168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:11.101210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:11.123614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:11.124194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:11.125066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:11.126148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:11.723055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:11.733028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:11.735357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:11.736835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7927c5ae-068c-418f-8f26-f62e1b6827b6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.643139 Apr 09 01:59:11.737658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 312/621] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:11 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:12.764370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:12.765613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:12.809244 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:12.810167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:12.811284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:12.812227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:13.361643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:13.396629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:13.399761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:13.406289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8ee68744-be2b-4714-8643-ca1e80299fc7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.646040 Apr 09 01:59:13.409763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 310/622] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:12 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:14.441153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:14.443018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:14.465076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:14.467474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:14.469824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:14.473377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:15.384487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:15.398860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:15.400576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:15.401809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bba7b34a-6176-470d-9e50-c59fd0bffea9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.966380 Apr 09 01:59:15.406579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 313/623] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:14 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:16.426771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:16.427550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:16.443059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:16.454471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:16.458285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:16.461734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:17.090660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:17.130203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:17.131980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:17.133497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-92c3b8cf-c5ed-4cf4-9093-e3a975261f34 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.711862 Apr 09 01:59:17.134106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 311/624] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:16 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:18.154625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:18.155185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:18.182791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:18.185270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:18.186350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:18.188499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:19.215879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:19.245413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:19.257488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:19.258786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ba856530-792f-4a64-810a-09132068f7b0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 1.108694 Apr 09 01:59:19.259819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 314/625] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:18 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:20.281780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:20.282570 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:20.295364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:20.295881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:20.301074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:20.302071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:20.544744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:20.566388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:20.569047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:20.570556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5a693b82-5b55-418f-b4c3-ec0f74d4cf1c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1738 microversion: 2.20 time: 0.295140 Apr 09 01:59:20.571954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 312/626] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:20 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:21.591164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:21.592608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:21.601692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:21.602546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:21.603622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:21.604355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:21.829410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:21.839981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:21.841891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:21.843190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ea830794-d05b-4204-9679-6d290940986d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1720 microversion: 2.20 time: 0.256169 Apr 09 01:59:21.844406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 315/627] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:21 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:22.865447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:22.870490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:22.888988 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:22.889797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:22.891757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:22.892578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:23.263848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:23.276974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:23.279041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:23.280467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ecf34733-855d-41b1-bda8-49707e1fb345 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1720 microversion: 2.20 time: 0.419307 Apr 09 01:59:23.281119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 313/628] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:22 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1720 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:23.547224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-f79b03a1-89eb-4152-b846-b24a822b4603 req-d5b6970e-2f13-4e38-82f4-291a6c62d7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "name": "network-vif-unplugged", "status": "completed", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:23.550662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 01:59:23.550662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 01:59:23.572630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f79b03a1-89eb-4152-b846-b24a822b4603 req-d5b6970e-2f13-4e38-82f4-291a6c62d7af service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:23.587410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f79b03a1-89eb-4152-b846-b24a822b4603 req-d5b6970e-2f13-4e38-82f4-291a6c62d7af service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:23.636370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-f79b03a1-89eb-4152-b846-b24a822b4603 req-d5b6970e-2f13-4e38-82f4-291a6c62d7af service nova] Creating event network-vif-unplugged:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 01:59:23.643692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-f79b03a1-89eb-4152-b846-b24a822b4603 req-d5b6970e-2f13-4e38-82f4-291a6c62d7af service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100775 Apr 09 01:59:23.644508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 314/629] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 01:59:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 01:59:23.795673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Action: 'create', calling method: .version_select at 0x7f966d497378>, body: {"keypair": {"name": "tempest-TestShelveInstance-855700500"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:23.823724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:59:23.828281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for user aacc7d9fd172477f9ae43e084f499884 and project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:59:24.092083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 01:59:24.096623 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for user aacc7d9fd172477f9ae43e084f499884 and project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 01:59:24.120268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-511a3dc1-2f19-44ce-912c-8a06310fb499 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.614760 Apr 09 01:59:24.121131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 316/630] 10.222.0.38 () {60 vars in 1148 bytes} [Fri Apr 9 01:59:23 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:59:24.307208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:24.308333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:24.317379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:24.318250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:24.319386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:24.319980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:24.581467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:24.591848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:24.593575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:24.595593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9024a7ee-1829-433d-8834-3d28d76a5d7a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1720 microversion: 2.20 time: 0.296986 Apr 09 01:59:24.596293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 315/631] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:24 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1720 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:25.620723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:25.620723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:25.625202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:25.625728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:25.626671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:25.627162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:25.837206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:25.847228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:25.848956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:25.850202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b186915f-8f12-4cb6-a5dc-65072966138e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1720 microversion: 2.20 time: 0.238843 Apr 09 01:59:25.851050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 317/632] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:25 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:26.872232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:26.873007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:26.882792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:26.883647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:26.884769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:26.885576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:27.451098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:27.462171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:27.464136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:27.465868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9a52454f-f1af-4c13-b718-b782df94ef62 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1720 microversion: 2.20 time: 0.598578 Apr 09 01:59:27.479877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 316/633] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:26 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1720 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:28.495408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:28.496818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:28.539418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:28.540559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:28.545538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:28.555202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:29.095294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:29.112392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:29.114043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:29.119641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-58cc7e1e-f5e1-42a1-a3e3-355fb0d62ea2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1723 microversion: 2.20 time: 0.635911 Apr 09 01:59:29.120922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 318/634] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:28 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1723 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:29.141648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7864c45-4ee9-4e17-a403-f403b6be1778"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:29.142930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:29.159283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:29.163759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:29.167361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:29.168872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:29.687194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-922bd3c9-408a-4667-b5e1-3252a832604a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.546972 Apr 09 01:59:29.687194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 317/635] 10.222.0.38 () {62 vars in 1354 bytes} [Fri Apr 9 01:59:29 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments => generated 188 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 01:59:29.888405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 01:59:29.897556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:29.915617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:29.917251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:29.919444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:29.920765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:30.204801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-01191ab1-12ae-4f57-ad04-0e95d99e3059 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action" status: 202 len: 0 microversion: 2.20 time: 0.325547 Apr 09 01:59:30.206090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 319/636] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 01:59:29 2021] POST /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:59:30.221880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:30.223954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:30.255361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:30.257439 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:30.259384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:30.260685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:30.577351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:30.590926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:30.595006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:30.596868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a8ee174f-e8b5-4ba3-9a6e-d686344a1e12 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1749 microversion: 2.20 time: 0.383812 Apr 09 01:59:30.608895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 318/637] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:30 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1749 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:31.618315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:31.618959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:31.628171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:31.628684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:31.629533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:31.630014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:31.867766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:31.878888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:31.881086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:31.881862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42730549-0e3e-4099-bb8d-626e54edfef4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1749 microversion: 2.20 time: 0.267756 Apr 09 01:59:31.882703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 320/638] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:31 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1749 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:32.912519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:32.913810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:32.930519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:32.931411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:32.933389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:32.934294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:33.194097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:33.209435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:33.211558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:33.213268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3465c177-8296-46b0-ac7c-e3907d78fd48 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1751 microversion: 2.20 time: 0.312580 Apr 09 01:59:33.214634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 319/639] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:32 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1751 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:34.117933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 01:59:34.118728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 01:59:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 01:59:34.239232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:34.240525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:34.255616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:34.256600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:34.258051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:34.258921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:34.907237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:34.918979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:34.920752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:34.922067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6a1d2629-c281-4eb5-b75b-0c114bf1aeee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1751 microversion: 2.20 time: 0.691309 Apr 09 01:59:34.922692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 321/640] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:34 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1751 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:35.944667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:35.945256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:35.957712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:35.957712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:35.957712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:35.957712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:36.241151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:36.254466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:36.257001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:36.258981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f98e73ab-c7cb-49a3-95bc-89c67a60dcae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.318675 Apr 09 01:59:36.260068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 320/641] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:35 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:37.281228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:37.282146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:37.298046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:37.298620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:37.299804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:37.303493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:37.756344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:37.771668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:37.774563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:37.776251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a4d0cd45-c7b1-48a4-8c38-74800a355178 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.499804 Apr 09 01:59:37.791787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 322/642] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:37 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:38.801608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:38.802653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:38.812709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:38.813199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:38.814254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:38.814937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:39.262578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:39.306681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:39.312747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:39.312747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ac07c623-b9f0-4dc7-9483-a309881646d4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.512876 Apr 09 01:59:39.312747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 321/643] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:38 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:40.359873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:40.365345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:40.385503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:40.386925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:40.389415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:40.391090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:40.974704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:41.032599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:41.038009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:41.042140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-86fffc9d-b53d-41e0-8a31-3a5236b534e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.690325 Apr 09 01:59:41.044167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 323/644] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:40 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:42.069495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:42.070669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:42.112494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:42.113753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:42.115644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:42.117403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:43.512239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:43.547832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:43.553455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:43.556484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ca5e02b3-adeb-49d1-aeff-2ed16a4c8714 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 1.495523 Apr 09 01:59:43.558035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 322/645] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:42 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:44.598808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:44.601902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:44.619260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:44.619935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:44.621175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:44.622024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:44.921965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:44.939354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:44.941311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:44.942598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0d9fcc1b-f243-4958-ac7b-9c11cb817f61 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.354246 Apr 09 01:59:44.943242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 324/646] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:44 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:45.976600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:45.980416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:46.032336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:46.034684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:46.038294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:46.040363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:46.411487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:46.437619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:46.441999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:46.444531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fc9ce01b-b87d-4044-a7bf-232edabdba21 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.483678 Apr 09 01:59:46.446007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 323/647] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:45 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:47.466942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:47.468034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:47.478227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:47.479470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:47.480411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:47.481088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:47.746252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:47.768574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:47.772472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:47.774968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d8f081ab-ce91-4ef5-a7b1-6b021fff7c24 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.312397 Apr 09 01:59:47.776166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 325/648] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:47 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 01:59:48.802899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:48.804648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:48.823194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:48.824468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:48.826846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:48.828928 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:49.710849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:49.729999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:49.733846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:49.737464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2e56a54b-aa37-41ba-af8e-b840875a01e3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.942943 Apr 09 01:59:49.738969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 324/649] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:48 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:50.773320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:50.774108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:50.783823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:50.784330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:50.785165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:50.785654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:51.579767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:51.595633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:51.597408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:51.598727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0b9095ac-7d66-46fe-bd67-7aa59ab66f2c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.830084 Apr 09 01:59:51.599742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 326/650] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:50 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:51.787475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:51.788336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:51.797141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:51.797647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:51.798519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:51.799010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:51.869994 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 01:59:52.025688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f7b80fc5-dad2-421a-ba2d-c45240d78596 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 204 len: 0 microversion: 2.1 time: 0.241434 Apr 09 01:59:52.026944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 325/651] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 01:59:51 2021] DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 01:59:52.041353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:52.042587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:52.058598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:52.059364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:52.060767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:52.061548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:52.636164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:52.637926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:52.670981 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:52.671901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:52.673705 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:52.674649 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:52.710714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:52.725350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8c1ceb98-8bd6-42e9-9a63-937a1e17d443 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1672 microversion: 2.1 time: 0.692384 Apr 09 01:59:52.725989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 327/652] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:52 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1672 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:53.121395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:53.144847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:53.148891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:53.151191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-480c231d-f822-4557-9009-d867e050e00f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.525273 Apr 09 01:59:53.152317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 326/653] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:52 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:53.758335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:53.759614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:53.769741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:53.770214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:53.771100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:53.771585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:54.114392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:54.129440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4dc8aa35-c212-4cb2-9603-33a37f3d6352 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1672 microversion: 2.1 time: 0.375438 Apr 09 01:59:54.134948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 328/654] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:53 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1672 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 01:59:54.175265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:54.175904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:54.184822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:54.185604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:54.186653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:54.187361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:54.450619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:54.470342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:54.474360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:54.477071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3efd9fa8-8131-401a-95f5-917804b43348 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.306368 Apr 09 01:59:54.478417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 327/655] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:54 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:55.167847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:55.169196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:55.178690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:55.179191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:55.180127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:55.180841 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:55.524039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:55.526288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:55.541784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:55.545718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:55.550410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:55.552303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d186e115-fb12-411e-b042-58f512cb11be tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1672 microversion: 2.1 time: 0.394168 Apr 09 01:59:55.552951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 329/656] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:55 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1672 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:55.566083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:55.567325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:56.137001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:56.160292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:56.164360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:56.173246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1c0da163-cb51-481f-90b6-35acdc9b31ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.656598 Apr 09 01:59:56.175864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 328/657] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:55 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:56.590096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:56.591938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:56.608708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:56.611069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:56.613112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:56.614359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:57.213622 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:57.215010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:57.227175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:57.238371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:57.240362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:57.243703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:57.294591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 01:59:57.295517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 01:59:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 (ip 10.222.0.38) !!! Apr 09 01:59:57.762403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:57.798444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f2282932-727f-4fbd-b9f8-096b67a4705b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1672 microversion: 2.1 time: 1.216100 Apr 09 01:59:57.799423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 330/658] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:56 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1672 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 01:59:58.316389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:58.360579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:58.364519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:58.367018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d9b085d4-160b-4fad-b8a1-4fb948ea05b9 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 1.157531 Apr 09 01:59:58.368218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 329/659] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:57 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 01:59:58.830802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:58.833699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:58.883148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:58.883641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:58.888937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:58.889678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:59.403171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 01:59:59.404064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 01:59:59.417670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:59.418601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:59.419758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 01:59:59.420556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 01:59:59.678763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 01:59:59.697208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d30bf31-5b79-41f8-b8a7-7304744e8eca tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1672 microversion: 2.1 time: 0.882237 Apr 09 01:59:59.697904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 331/660] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 01:59:58 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1672 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:00.061079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-432469955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-855700500", "security_groups": [{"name": "tempest-secgroup-smoke-37870597"}], "networks": [{"uuid": "fd0911d7-2183-43e3-9703-f2a48c7303e9"}], "block_device_mapping_v2": [{"uuid": "1424d127-29d3-441c-84ef-49eb2ae7e4e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:00.705998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:00.718461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] validate_networks() for [('fd0911d7-2183-43e3-9703-f2a48c7303e9', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:00:00.752227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:00.756972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:00.767595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-26a23a95-d990-4288-9412-5852b6dcce20 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 1.368247 Apr 09 02:00:00.769460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 330/661] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 01:59:59 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 02:00:00.797508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:00.799596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:00.840187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:00.841639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:00.844246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:00.845738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:01.347653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:01.369788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-252b846c-71c4-4da0-b56e-19e8f580aaad tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1605 microversion: 2.1 time: 0.598141 Apr 09 02:00:01.381809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 331/662] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:00 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1605 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:01.798652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:01.800473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:01.821871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:01.822867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:01.827934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:01.828924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:02.718881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:02.740284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:02.743898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:02.747864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b3e99e0d-6f5b-430c-be45-eefd1c7668e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.953617 Apr 09 02:00:02.749511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 332/663] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:01 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:02.760024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:02.763752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:02.781661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:02.784771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:02.787601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:02.789656 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:03.884878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:03.947071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a9902cd9-0d2e-4abd-ad59-3b7f22e62a92 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 200 len: 1322 microversion: 2.1 time: 1.193601 Apr 09 02:00:03.960663 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 333/664] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:02 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 1322 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:04.341537 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:00:04.342013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:00:04.343670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:00:04.344204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:00:04.344680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:00:04.364849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.373697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.375229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.376302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.423782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:04.429520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Getting quotas for user aacc7d9fd172477f9ae43e084f499884 and project ac3b8f7fb01041abac3b9215f681e4e1. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:04.591214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-c373ea56-048c-4304-924b-ba006dd8d339 req-ec12adf5-b92d-429a-a545-94f6cd721756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7113ca87-3a31-415b-b770-e7f4ce41b0cc", "name": "network-vif-deleted", "tag": "2c15aeb3-3de9-476f-bed1-ad9f77db7c11"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:04.605472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:00:04.608247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:04.608247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:04.610490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1424d127-29d3-441c-84ef-49eb2ae7e4e2',volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:00:04.646156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-c373ea56-048c-4304-924b-ba006dd8d339 req-ec12adf5-b92d-429a-a545-94f6cd721756 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.647063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-c373ea56-048c-4304-924b-ba006dd8d339 req-ec12adf5-b92d-429a-a545-94f6cd721756 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.688680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-c373ea56-048c-4304-924b-ba006dd8d339 req-ec12adf5-b92d-429a-a545-94f6cd721756 service nova] Creating event network-vif-deleted:2c15aeb3-3de9-476f-bed1-ad9f77db7c11 for instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc on hv-cinder-78462 Apr 09 02:00:04.701871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-c373ea56-048c-4304-924b-ba006dd8d339 req-ec12adf5-b92d-429a-a545-94f6cd721756 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.738843 Apr 09 02:00:04.703892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 334/665] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:04.710145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-1eaf63d9-022c-42a8-b7cc-3ea06a39744f req-622b4eaf-289a-40fa-aa3e-64183a643fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "name": "network-vif-plugged", "status": "completed", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:04.711917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:04.711917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:04.741684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1eaf63d9-022c-42a8-b7cc-3ea06a39744f req-622b4eaf-289a-40fa-aa3e-64183a643fd1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.742351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1eaf63d9-022c-42a8-b7cc-3ea06a39744f req-622b4eaf-289a-40fa-aa3e-64183a643fd1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.779542 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-1eaf63d9-022c-42a8-b7cc-3ea06a39744f req-622b4eaf-289a-40fa-aa3e-64183a643fd1 service nova] Creating event network-vif-plugged:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 02:00:04.798053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-1eaf63d9-022c-42a8-b7cc-3ea06a39744f req-622b4eaf-289a-40fa-aa3e-64183a643fd1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092275 Apr 09 02:00:04.798760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 335/666] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:04.804680 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:04.805389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:04.832183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.832704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.833576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:04.834069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:04.985528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-02fc8d34-4461-4e8d-b9cf-69bf742c3ef7 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 4.934580 Apr 09 02:00:05.009747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 332/667] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:00:00 2021] POST /compute/v2.1/servers => generated 404 bytes in 4959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:00:05.016287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:05.017404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:05.031123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:05.032082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:05.033190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:05.033900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:05.161737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. Apr 09 02:00:05.162799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:00:05.164354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8b35208e-45ba-4fda-a4bc-56f6275fa276 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 404 len: 111 microversion: 2.1 time: 0.153100 Apr 09 02:00:05.167020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 333/668] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:05 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:00:05.175569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ee9493a6-81a8-428e-922c-4e5c32aa7bc1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:05.177728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ee9493a6-81a8-428e-922c-4e5c32aa7bc1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:05.376461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ee9493a6-81a8-428e-922c-4e5c32aa7bc1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:05.388143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ee9493a6-81a8-428e-922c-4e5c32aa7bc1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1087 microversion: 2.1 time: 0.219096 Apr 09 02:00:05.389201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 334/669] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:05 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1087 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:05.426533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b80b6f17-0c10-41e3-9db1-ce19cf0a0112 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '.version_select at 0x7f966de31ae8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:05.507033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b80b6f17-0c10-41e3-9db1-ce19cf0a0112 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110122593" status: 202 len: 0 microversion: 2.1 time: 0.116126 Apr 09 02:00:05.512527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 335/670] 10.222.0.38 () {58 vars in 1211 bytes} [Fri Apr 9 02:00:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110122593 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:00:05.542210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:05.566288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:05.570034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:05.572820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6aac1d1c-dc7c-4429-ab1b-09bf007c7aac tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 0.772256 Apr 09 02:00:05.574031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 336/671] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:04 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:06.429377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:06.430770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:06.454279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:06.455111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:06.457015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:06.458272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:06.607466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:06.609253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:06.655963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:06.656799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:06.658423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:06.659342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:06.781756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:06.808434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1e6da690-8ff3-4702-ad85-ffa9665773a8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1137 microversion: 2.1 time: 0.391999 Apr 09 02:00:06.820788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 336/672] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:06 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1137 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:07.844924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:07.861980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:07.944255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:07.945984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:07.964405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:07.965796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:08.533823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:08.558185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f5b88aed-6fe7-4f7f-8899-cb75ce87912a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1185 microversion: 2.1 time: 0.719347 Apr 09 02:00:08.558918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 337/673] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:07 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1185 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:08.774416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:08.799305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:08.801305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:08.803248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-261382e5-f162-4b41-9324-cbb5a7f3aaae tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 2.203572 Apr 09 02:00:08.804143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 337/674] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:06 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:08.908760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: .version_select at 0x7f966d2731e0>, body: {"keypair": {"name": "tempest-keypair-220531237"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:08.965892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:08.979793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:09.353706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:09.378787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:09.426707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3a1440b0-0d93-4cf6-b6ec-0dfe55ee6a29 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.524461 Apr 09 02:00:09.442435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 338/675] 10.222.0.38 () {60 vars in 1148 bytes} [Fri Apr 9 02:00:08 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:09.585381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:09.586080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:09.651921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:09.656677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:09.657929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:09.658555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:09.855374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:09.856625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:09.898991 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:09.901366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:09.908569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:09.911846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:10.049072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:10.118607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-294b8cc1-2171-4e97-bb84-8ef2ea60f3df tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1203 microversion: 2.1 time: 0.539860 Apr 09 02:00:10.125403 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 338/676] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:09 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1203 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:10.956034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:10.987855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:10.992762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:10.995720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fcec5e81-7bb6-445a-86f7-12cadc7e3618 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 1.155295 Apr 09 02:00:11.002139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 339/677] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:09 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:11.161434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:11.162563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:11.181310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:11.184992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:11.185614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:11.186015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:11.696326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:11.718976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cc7ed6b5-f99b-46d7-b952-0b083b9e9a45 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1203 microversion: 2.1 time: 0.561391 Apr 09 02:00:11.740169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 339/678] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:11 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1203 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:12.032158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:12.033762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:12.059588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:12.061010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:12.062888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:12.064243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:12.738036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:12.739229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:12.759487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:12.761267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:12.763069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:12.765626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:13.399953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:13.417220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:13.422834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:13.432311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c4faf78-b605-4654-8e1c-c170c36c4617 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1807 microversion: 2.20 time: 1.405435 Apr 09 02:00:13.433491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 340/679] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:12 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1807 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:13.700493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:13.719704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-096ea5de-fe4b-4538-9232-e5d019b512dc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.985790 Apr 09 02:00:13.733713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 340/680] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:12 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:14.452794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:14.454242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:14.463192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:14.464635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:14.465984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:14.466773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:14.763048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:14.765225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:14.806778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:14.816481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:14.823161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:14.826296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:15.935564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:15.955655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:16.006948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-59c51399-94b7-410b-bbee-e3221210bb20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 1.256800 Apr 09 02:00:16.012731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:16.018907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 341/681] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:14 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:16.027079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:16.030488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-717bb012-6878-448c-a67a-b91d6dac5c3f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1794 microversion: 2.20 time: 1.581181 Apr 09 02:00:16.032064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 341/682] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:14 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1794 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:17.013179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-53059ad0-f9da-4558-a37f-01555b126e7a req-758a5739-f56d-4a10-a204-76ea456fe780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:17.018733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:17.018733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:17.033520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-53059ad0-f9da-4558-a37f-01555b126e7a req-758a5739-f56d-4a10-a204-76ea456fe780 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:17.034277 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-53059ad0-f9da-4558-a37f-01555b126e7a req-758a5739-f56d-4a10-a204-76ea456fe780 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:17.042974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:17.044199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:17.054673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-53059ad0-f9da-4558-a37f-01555b126e7a req-758a5739-f56d-4a10-a204-76ea456fe780 service nova] Creating event network-changed:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:00:17.064869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-53059ad0-f9da-4558-a37f-01555b126e7a req-758a5739-f56d-4a10-a204-76ea456fe780 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.615153 Apr 09 02:00:17.067666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 342/683] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:17.070277 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:17.070926 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:17.071645 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:17.072199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:17.976617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:18.004867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-237a3713-8e39-4397-8eaf-d7b3b33c11a1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.971469 Apr 09 02:00:18.009132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 342/684] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:17 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:18.688152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-410159659", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14cb7a3-6ad5-45e4-b2a1-6f9d83bedcb3"}], "security_groups": [{"name": "tempest-securitygroup--404210278"}], "key_name": "tempest-keypair-220531237", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:18.903096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] validate_networks() for [('b14cb7a3-6ad5-45e4-b2a1-6f9d83bedcb3', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:00:19.028323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:19.029792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:19.038989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:19.039897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:19.041227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:19.042283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:19.370939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:19.384404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-94e012f9-e41f-4482-9f7f-f64d063ba404 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.361298 Apr 09 02:00:19.385297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 343/685] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:19 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:19.917491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Action: 'create', calling method: .version_select at 0x7f9671deb620>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2115141322"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:20.002520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:20.007495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for user 03a5b233a6884b07ad75e45ff0d67453 and project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:20.190405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:00:20.191506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:00:20.192815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:00:20.193908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:00:20.194834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:00:20.211467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:20.219862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:20.221524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:20.222395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:20.251077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:20.260142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for user 03a5b233a6884b07ad75e45ff0d67453 and project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:20.274304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for project 04741939d3534ea99b01d960cf92f527. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:20.283028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Getting quotas for user faf95307e0f04775b0fcd89f870184c1 and project 04741939d3534ea99b01d960cf92f527. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:20.286113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7c336750-429a-49c7-81e1-7181a0e45d22 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.898909 Apr 09 02:00:20.288158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 344/686] 10.222.0.38 () {60 vars in 1148 bytes} [Fri Apr 9 02:00:19 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:20.306049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:00:20.314544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:00:20.403822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:20.404816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:20.415588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:20.416519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:20.417606 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:20.418346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:20.438190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-84f6ffce-f5d2-49ab-be13-70b975638484 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.755464 Apr 09 02:00:20.438913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 343/687] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:00:18 2021] POST /compute/v2.1/servers => generated 401 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:00:20.453300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-461bfae8-87a1-4037-be09-6aee3ff8f312 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:20.454215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-461bfae8-87a1-4037-be09-6aee3ff8f312 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:20.634493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-461bfae8-87a1-4037-be09-6aee3ff8f312 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:20.649231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-461bfae8-87a1-4037-be09-6aee3ff8f312 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1236 microversion: 2.1 time: 0.201317 Apr 09 02:00:20.651435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 344/688] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:20 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1236 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:20.823037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:20.860857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-522fd307-a142-4d64-88bc-f25c8b87edb9 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.460740 Apr 09 02:00:20.871661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 345/689] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:20 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:21.675136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:21.677878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:21.697799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:21.700364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:21.703657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:21.705640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:21.907199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:21.908802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:21.927219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:21.927956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:21.929824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:21.930975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:22.005451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:22.024914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d55aaca9-f28b-4bca-9a2a-4309eea2b0b4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1288 microversion: 2.1 time: 0.353427 Apr 09 02:00:22.032077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 345/690] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:21 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1288 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:22.311365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:22.333858 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f199217e-bb5f-42cd-be5e-2795936b908e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.431391 Apr 09 02:00:22.335301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 346/691] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:21 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:23.057063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:23.058827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:23.081576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:23.086191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:23.090513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:23.093029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:23.371029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:23.379954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:23.409023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:23.409890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:23.411414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:23.412268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:23.521393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:23.534193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-da42355b-9634-4256-a0c6-bece905872da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1294 microversion: 2.1 time: 0.484351 Apr 09 02:00:23.534874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 346/692] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:23 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1294 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:23.846838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:23.884143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2ac3a50-a4c7-4edb-a07e-4bb9dc68558e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.522380 Apr 09 02:00:23.888995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 347/693] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:23 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:24.568388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:24.577146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:24.602301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:24.604657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:24.609018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:24.613837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:24.923690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:24.924690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:24.943580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:24.944298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:24.945346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:24.945837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:24.996210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:25.033688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6c54f597-d86d-45e8-838d-48705e31590a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.483048 Apr 09 02:00:25.035215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 347/694] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:24 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:25.241005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:25.258081 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-47b6551b-7f0d-4d34-bb90-677fc8b671d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.340584 Apr 09 02:00:25.258873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 348/695] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:24 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:26.053791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:26.054650 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:26.064806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:26.065327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:26.066348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:26.066965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:26.326141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:26.327725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:26.349723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:26.350249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:26.351198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:26.351602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:26.396994 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:26.409695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-582d1c7e-dde5-4a53-a4e3-5880aeadc404 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.359618 Apr 09 02:00:26.413871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 348/696] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:26 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:26.443584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-ee19b1da-dd2b-46dc-b748-8f7c7701f585 req-004b41b0-c35a-4ae5-bca3-857e689a8212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f92def9-b701-4c5a-b5bf-935d452a5f01", "tag": "4f9e1053-02e4-41a2-810b-44dbe3882f43"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:26.455384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:26.455384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:26.485288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ee19b1da-dd2b-46dc-b748-8f7c7701f585 req-004b41b0-c35a-4ae5-bca3-857e689a8212 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:26.486664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ee19b1da-dd2b-46dc-b748-8f7c7701f585 req-004b41b0-c35a-4ae5-bca3-857e689a8212 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:26.534559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-ee19b1da-dd2b-46dc-b748-8f7c7701f585 req-004b41b0-c35a-4ae5-bca3-857e689a8212 service nova] Creating event network-changed:4f9e1053-02e4-41a2-810b-44dbe3882f43 for instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 on hv-cinder-78462 Apr 09 02:00:26.550537 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-ee19b1da-dd2b-46dc-b748-8f7c7701f585 req-004b41b0-c35a-4ae5-bca3-857e689a8212 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129318 Apr 09 02:00:26.551822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 349/697] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:26.701031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:26.718803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-811fa662-e7d8-40ad-820b-a35f185f6e12 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.432562 Apr 09 02:00:26.719451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 349/698] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:26 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:27.433211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:27.440015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:27.449574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:27.450506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:27.451340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:27.452587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:27.739381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:27.740676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:27.769725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:27.773548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:27.776869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:27.780016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:27.803276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:27.820058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-599c343f-ef19-479a-90bc-94ebe0344bb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.390841 Apr 09 02:00:27.821431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 350/699] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:27 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:28.105719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:28.117316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-51fd87ac-baeb-40d5-af7f-8808ddf3f080 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.382579 Apr 09 02:00:28.118372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 350/700] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:27 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:28.552022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d6aea4db-cdc7-43c7-ba70-163d66387ab1 req-5fcc9d74-c859-4c7a-a36b-d1c3cb0e1b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "name": "network-vif-plugged", "status": "completed", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:28.553795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:28.553795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:28.563758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d6aea4db-cdc7-43c7-ba70-163d66387ab1 req-5fcc9d74-c859-4c7a-a36b-d1c3cb0e1b94 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:28.564303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d6aea4db-cdc7-43c7-ba70-163d66387ab1 req-5fcc9d74-c859-4c7a-a36b-d1c3cb0e1b94 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:28.586563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d6aea4db-cdc7-43c7-ba70-163d66387ab1 req-5fcc9d74-c859-4c7a-a36b-d1c3cb0e1b94 service nova] Creating event network-vif-plugged:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:00:28.592488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d6aea4db-cdc7-43c7-ba70-163d66387ab1 req-5fcc9d74-c859-4c7a-a36b-d1c3cb0e1b94 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242923 Apr 09 02:00:28.593433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 351/701] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:28.847701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:28.848769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:28.864280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:28.866148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:28.867365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:28.868073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:29.141943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:29.143036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:29.151962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:29.152556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:29.153778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:29.154378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:29.391101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:29.408532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-be879b30-7f9e-4cbf-ab19-72d62f364ba8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.564945 Apr 09 02:00:29.410212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 351/702] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:28 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:29.459199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:29.469400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9b8546bd-a5d0-4025-b13b-b1aa09af8d20 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1257 microversion: 2.1 time: 0.335307 Apr 09 02:00:29.470066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 352/703] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:29 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1257 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:30.439124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:30.442685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:30.475058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.476404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:30.478413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.479630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:30.488179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:30.488869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:30.497515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.498033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:30.498961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.499468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:30.852749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:30.865569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:30.868424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2a17e599-d8a5-47ef-ab90-a20a84130ff1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.433472 Apr 09 02:00:30.869543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 352/704] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:30 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:30.884076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e47251fc-7a8a-48bb-b227-67307b7c85d6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1441 microversion: 2.1 time: 0.400429 Apr 09 02:00:30.910089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 353/705] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:30 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1441 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:30.915386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:30.916203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:30.926857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.927384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:30.928600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:30.929096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:31.176740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:31.187896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f4acf465-d4f0-4f3c-ad94-9f56cbef7ef3 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1441 microversion: 2.1 time: 0.276396 Apr 09 02:00:31.188902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 353/706] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:30 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1441 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:31.888030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:31.890032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:31.915202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:31.920007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:31.926216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:31.927128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:32.245678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:32.259957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-53cbbdba-6049-4fef-9354-dec1e254eae0 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.376730 Apr 09 02:00:32.261725 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 354/707] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:31 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:32.477461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-5b6ea978-4f08-4ff4-a0ad-2c5245801ac1 req-92842f20-311d-4bab-ad1a-c2a8f22ded26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f92def9-b701-4c5a-b5bf-935d452a5f01", "name": "network-vif-plugged", "status": "completed", "tag": "4f9e1053-02e4-41a2-810b-44dbe3882f43"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:32.479690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:32.479690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:32.500687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5b6ea978-4f08-4ff4-a0ad-2c5245801ac1 req-92842f20-311d-4bab-ad1a-c2a8f22ded26 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:32.501192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5b6ea978-4f08-4ff4-a0ad-2c5245801ac1 req-92842f20-311d-4bab-ad1a-c2a8f22ded26 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:32.523491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-5b6ea978-4f08-4ff4-a0ad-2c5245801ac1 req-92842f20-311d-4bab-ad1a-c2a8f22ded26 service nova] Creating event network-vif-plugged:4f9e1053-02e4-41a2-810b-44dbe3882f43 for instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 on hv-cinder-78462 Apr 09 02:00:32.530064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-5b6ea978-4f08-4ff4-a0ad-2c5245801ac1 req-92842f20-311d-4bab-ad1a-c2a8f22ded26 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056237 Apr 09 02:00:32.531119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 354/708] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:33.284628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:33.285945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:33.299968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:33.300505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:33.301361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:33.301849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:33.603150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:33.613840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-31dc0036-0e4a-4b8a-982a-75af35b196cd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1361 microversion: 2.1 time: 0.337932 Apr 09 02:00:33.614501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 355/709] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:33 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:34.638397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:34.640245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:34.652215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:34.653428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:34.655618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:34.656412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:34.973137 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:34.989715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9da3020b-e7f5-440e-9fb0-c92f4d21e7c8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1547 microversion: 2.1 time: 0.359676 Apr 09 02:00:34.990683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 355/710] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:34 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1547 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:35.008420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:35.009235 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:35.018519 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:35.019296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:35.020379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:35.021031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:35.269786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d82bc7e-98da-43c7-9315-4a5d770458bd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265483 Apr 09 02:00:35.275644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 356/711] 10.222.0.38 () {58 vars in 1265 bytes} [Fri Apr 9 02:00:35 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:35.776564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-ac11fef7-423d-439f-a1e7-1ec5c9247397 req-83673383-ec5b-4d15-8b4f-abac37e2c1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:35.781061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:35.781061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:35.795929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ac11fef7-423d-439f-a1e7-1ec5c9247397 req-83673383-ec5b-4d15-8b4f-abac37e2c1f6 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:35.796959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-ac11fef7-423d-439f-a1e7-1ec5c9247397 req-83673383-ec5b-4d15-8b4f-abac37e2c1f6 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:35.827383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-ac11fef7-423d-439f-a1e7-1ec5c9247397 req-83673383-ec5b-4d15-8b4f-abac37e2c1f6 service nova] Creating event network-changed:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:00:35.836261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-ac11fef7-423d-439f-a1e7-1ec5c9247397 req-83673383-ec5b-4d15-8b4f-abac37e2c1f6 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067719 Apr 09 02:00:35.838005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 356/712] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:38.134141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:38.135452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:38.137392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d49d2280-e2ea-4538-99af-e6172bc00283 req-55ea43e4-bc0f-44ef-909e-3b87160a08f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f92def9-b701-4c5a-b5bf-935d452a5f01", "tag": "4f9e1053-02e4-41a2-810b-44dbe3882f43"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:38.139342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:38.139342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:38.150619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d49d2280-e2ea-4538-99af-e6172bc00283 req-55ea43e4-bc0f-44ef-909e-3b87160a08f3 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:38.151128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d49d2280-e2ea-4538-99af-e6172bc00283 req-55ea43e4-bc0f-44ef-909e-3b87160a08f3 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:38.152681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:38.153387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:38.154458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:38.155150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:38.171323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d49d2280-e2ea-4538-99af-e6172bc00283 req-55ea43e4-bc0f-44ef-909e-3b87160a08f3 service nova] Creating event network-changed:4f9e1053-02e4-41a2-810b-44dbe3882f43 for instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 on hv-cinder-78462 Apr 09 02:00:38.177051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d49d2280-e2ea-4538-99af-e6172bc00283 req-55ea43e4-bc0f-44ef-909e-3b87160a08f3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043934 Apr 09 02:00:38.177685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 357/713] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:00:38.339175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-79f6663f-7d4f-4625-9c90-2050194f6147 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.208939 Apr 09 02:00:38.344958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 357/714] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:38 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:39.358546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:39.361613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:39.376143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:39.377635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:39.379615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:39.380505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:39.527853 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2ac264a2-5c81-4c72-afa6-39edb05f70ee tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.177795 Apr 09 02:00:39.528768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 358/715] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:39 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:40.541377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:40.542548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:40.552351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:40.552781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:40.553651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:40.554149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:40.692209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-67ca6394-0101-4848-88b4-1ca29bf354f3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.155352 Apr 09 02:00:40.692917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 358/716] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:40 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:41.705007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:41.706329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:41.720396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:41.721498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:41.723067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:41.723971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:41.831273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1318725851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2115141322", "security_groups": [{"name": "tempest-secgroup-smoke-59632659"}], "block_device_mapping_v2": [{"uuid": "754d23a2-1a16-45ea-b898-e1a8de97a25e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1c93796-0098-4080-965f-a515624b9ca4"}]}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:41.861555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1fa44a84-63cf-4d39-8944-31692d94beb2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.160888 Apr 09 02:00:41.863002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 359/717] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:41 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:42.022481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] validate_networks() for [('e1c93796-0098-4080-965f-a515624b9ca4', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:00:42.633059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:00:42.633608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:00:42.634221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:00:42.634846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:00:42.635491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:00:42.646528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:42.647097 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:42.648185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:42.648744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:42.668797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:42.674104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for user 03a5b233a6884b07ad75e45ff0d67453 and project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:42.828114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:00:42.830646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='754d23a2-1a16-45ea-b898-e1a8de97a25e',volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:00:42.875404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:42.876609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:42.885994 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:42.886503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:42.888150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:42.888867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:43.019855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cde2485e-a9d0-41f0-8ab2-132b9c8a95ac tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.194075 Apr 09 02:00:43.020619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 359/718] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:00:41 2021] POST /compute/v2.1/servers => generated 404 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:00:43.031934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f74f8b31-993b-4d67-adb7-76b539c2c6b8 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:43.032643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f74f8b31-993b-4d67-adb7-76b539c2c6b8 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:43.063907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f81c31ef-a665-4e80-b6b1-7412da052fa2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.193465 Apr 09 02:00:43.067208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 360/719] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:42 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 09 02:00:43.113875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f74f8b31-993b-4d67-adb7-76b539c2c6b8 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:43.122979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f74f8b31-993b-4d67-adb7-76b539c2c6b8 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1095 microversion: 2.1 time: 0.095472 Apr 09 02:00:43.123918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 360/720] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:43 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:44.076293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:44.077434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:44.086207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:44.087404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:44.087551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:44.088215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:44.143218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:44.144101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:44.152917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:44.153518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:44.154590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:44.155045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:44.252314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d2c5213-366e-47a6-92e9-b2f916fe24dd tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.179797 Apr 09 02:00:44.253583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 361/721] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:44 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:44.612597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:44.622617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2f391369-bd34-47b8-8bf9-7e075cef124d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1201 microversion: 2.1 time: 0.484857 Apr 09 02:00:44.623256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 361/722] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:44 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1201 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:45.266980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:45.268310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:45.278005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:45.278572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:45.279432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:45.279922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:45.441530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-43dfd8b6-bac8-4fbd-b1a5-86dbb4aeedba tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.180513 Apr 09 02:00:45.442457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 362/723] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:45 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:45.651863 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:45.652565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:45.661591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:45.662105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:45.662979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:45.663481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:46.125565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:46.135353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a1000f83-7f1f-4c6c-bcc9-1f872220e0fb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.488240 Apr 09 02:00:46.136014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 362/724] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:45 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:46.454604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:46.455729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:46.464479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:46.464978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:46.465950 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:46.466302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:46.593985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-35363d8b-e3a6-4ef5-98a2-87a993f0c7f8 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 14 microversion: 2.1 time: 0.144088 Apr 09 02:00:46.595284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 363/725] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:46 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:00:47.091173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-208c7b85-3d94-4d67-a3b2-b1171ba80707 req-f0c4eb8c-f827-4326-8407-bc0749f2e17d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd", "tag": "6ccc6b33-8ac8-4278-a8df-c08a6caf6b01"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:47.093058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:47.093058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:47.102450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-208c7b85-3d94-4d67-a3b2-b1171ba80707 req-f0c4eb8c-f827-4326-8407-bc0749f2e17d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:47.103111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-208c7b85-3d94-4d67-a3b2-b1171ba80707 req-f0c4eb8c-f827-4326-8407-bc0749f2e17d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:47.125857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-208c7b85-3d94-4d67-a3b2-b1171ba80707 req-f0c4eb8c-f827-4326-8407-bc0749f2e17d service nova] Creating event network-changed:6ccc6b33-8ac8-4278-a8df-c08a6caf6b01 for instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd on hv-cinder-78462 Apr 09 02:00:47.130984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-208c7b85-3d94-4d67-a3b2-b1171ba80707 req-f0c4eb8c-f827-4326-8407-bc0749f2e17d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044779 Apr 09 02:00:47.131603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 363/726] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:47.155234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:47.156026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:47.165437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:47.165826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:47.166957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:47.167903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:47.541642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:47.551584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-841f5bed-d777-4c0d-817b-4adbeb338e15 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.401152 Apr 09 02:00:47.557061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 364/727] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:47 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:47.606809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:47.608516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:47.616701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:47.617200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:47.618031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:47.618516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:47.772221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d65ef36a-cc7d-40cb-b295-3079c33b9c05 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 3356 microversion: 2.1 time: 0.169592 Apr 09 02:00:47.775903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 364/728] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:47 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 3356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:48.569851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:48.570518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:48.579816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:48.580346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:48.581203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:48.581693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:48.784763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:48.786106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:48.796182 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:48.796701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:48.797579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:48.798076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:48.945973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2fce2e8f-1286-4cf8-a291-4d74f887a589 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 13039 microversion: 2.1 time: 0.165738 Apr 09 02:00:48.946699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 365/729] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:48 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 13039 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:49.121315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:49.130194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db9a35a5-a796-4fe0-a2ce-b84806d2e71f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.564511 Apr 09 02:00:49.130830 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 365/730] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:48 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:49.379566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:49.380182 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:49.389255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.389765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:49.390605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.391100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:49.459157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-757a133b-4178-4e47-b47a-1f38c20cd981 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments/c7864c45-4ee9-4e17-a403-f403b6be1778" status: 200 len: 194 microversion: 2.20 time: 0.084352 Apr 09 02:00:49.459812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 366/731] 10.222.0.38 () {60 vars in 1444 bytes} [Fri Apr 9 02:00:49 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments/c7864c45-4ee9-4e17-a403-f403b6be1778 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:49.572434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:49.572983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:49.581469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.581982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:49.582826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.583319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:49.764982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lazy-loading 'services' on Instance uuid 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:00:49.911023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c4af8cf8-f28c-494b-a32b-166abb5b5f88 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments/c7864c45-4ee9-4e17-a403-f403b6be1778" status: 202 len: 0 microversion: 2.20 time: 0.342530 Apr 09 02:00:49.911692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 366/732] 10.222.0.38 () {60 vars in 1447 bytes} [Fri Apr 9 02:00:49 2021] DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48/os-volume_attachments/c7864c45-4ee9-4e17-a403-f403b6be1778 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:00:49.958866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:49.959917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:49.968224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.968734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:49.969587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:49.970086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:50.105745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-702302f3-9808-46f8-8d1b-46ddd4656278 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 18356 microversion: 2.1 time: 0.150627 Apr 09 02:00:50.106534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 367/733] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:49 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 18356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:50.147976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:50.148794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:50.157184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:50.157691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:50.158546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:50.159041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:50.360475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:50.369713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b68fd635-4630-49ef-aa24-0bd67621ec1c tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.226328 Apr 09 02:00:50.370484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 367/734] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:50 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:51.119884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:51.120775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:51.129921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.130420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.131541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.132256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.138996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:51.139579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:51.150108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.150511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.151380 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.151868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.225579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:00:51.280719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fc154eac-303a-44a8-a30b-129dc338fcf6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 19295 microversion: 2.1 time: 0.165299 Apr 09 02:00:51.284760 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 368/735] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:51 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 19295 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:51.349585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-daf76fcd-3aea-4875-95ff-7716bc4270d1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 204 len: 0 microversion: 2.20 time: 0.215264 Apr 09 02:00:51.350234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 368/736] 10.222.0.38 () {60 vars in 1270 bytes} [Fri Apr 9 02:00:51 2021] DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 02:00:51.359893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:51.360925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:51.374336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.374923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.375947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.376627 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.389450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:51.390261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:51.398398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.398903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.399753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:51.400325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:51.687017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:51.691466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:51.696754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:51.698428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:51.699671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-767edce1-d71b-471c-8661-a571d8e7d636 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.344632 Apr 09 02:00:51.700323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d124a322-0817-41d6-a516-6f27f17fafb0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.316126 Apr 09 02:00:51.700447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 369/737] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:51 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:51.700942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 369/738] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:51 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:52.293139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:52.294185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:52.302147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.302654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:52.303504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.304036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:52.454425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b4da3a40-e737-479c-930e-a03e9e7bc5da tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 21288 microversion: 2.1 time: 0.165150 Apr 09 02:00:52.455398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 370/739] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:52 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 21288 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:52.718275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:52.718942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:52.720278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:52.721682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:52.727070 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.727620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:52.728503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.728996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:52.730538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.731046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:52.731885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:52.732408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:53.030480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:53.038283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:53.040694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:53.042383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:53.043626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fec9a42e-b21c-48bc-a563-d76547f4db4d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1722 microversion: 2.20 time: 0.328037 Apr 09 02:00:53.044282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 371/740] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:52 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 02:00:53.047297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5181f5f6-8cfe-45ae-858f-eea9ce0965e6 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.333194 Apr 09 02:00:53.047924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 370/741] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:52 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:53.465920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:53.467142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:53.475024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:53.475526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:53.476484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:53.477019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:53.610646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-dc6a403b-bf09-4d25-a6e9-84b791b9fe48 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 22980 microversion: 2.1 time: 0.148286 Apr 09 02:00:53.611499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 372/742] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:53 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 22980 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:54.063945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:54.064886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:54.066934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:54.067766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:54.073318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.073911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.074897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.075459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.076610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.077120 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.077967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.078463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.389175 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:54.401713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:54.403408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:54.405571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e014b5da-f1cc-44eb-93d9-dd3e3a068d6d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1655 microversion: 2.20 time: 0.346189 Apr 09 02:00:54.410543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 371/743] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:54 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1655 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:54.623158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:54.624362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:54.632029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:54.632783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.633283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.634135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:54.634617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:54.642413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ddaf0350-3fe7-4445-9eb9-8e5554603bf3 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.580368 Apr 09 02:00:54.643353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 373/744] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:54 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:00:54.769338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-975282a7-790a-4c2e-8801-83db54cbc316 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 23803 microversion: 2.1 time: 0.149911 Apr 09 02:00:54.774024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 372/745] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:54 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 23803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 02:00:55.019784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3891954e-5504-4ce8-96f5-f957939e7c85 req-c9fa825d-7dc2-411c-b432-999e2293405a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c14a62f-95a1-44dd-8d6a-b490bcf95c48", "name": "network-vif-deleted", "tag": "71b85585-c25f-4f99-b8af-0177009e9005"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:55.021539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:55.021539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:55.040082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3891954e-5504-4ce8-96f5-f957939e7c85 req-c9fa825d-7dc2-411c-b432-999e2293405a service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.040592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3891954e-5504-4ce8-96f5-f957939e7c85 req-c9fa825d-7dc2-411c-b432-999e2293405a service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.063061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3891954e-5504-4ce8-96f5-f957939e7c85 req-c9fa825d-7dc2-411c-b432-999e2293405a service nova] Creating event network-vif-deleted:71b85585-c25f-4f99-b8af-0177009e9005 for instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 on hv-cinder-78462 Apr 09 02:00:55.068593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3891954e-5504-4ce8-96f5-f957939e7c85 req-c9fa825d-7dc2-411c-b432-999e2293405a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052986 Apr 09 02:00:55.069279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 374/746] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:55.431869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:55.432749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:55.442207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.442723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.443599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.444112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.525558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.526294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.526498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lazy-loading 'fault' on Instance uuid 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:00:55.610982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:55.621470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:55.623913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:55.625392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c20063f1-45ec-4ba6-9b66-dad264ee9c65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 200 len: 1371 microversion: 2.20 time: 0.198471 Apr 09 02:00:55.634726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 373/747] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:55 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:00:55.662985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:55.663757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:55.673393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.674153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.675061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.675515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.782946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:55.784106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:55.792407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.792907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.793754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:55.794236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:55.889593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:55.911949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cf011637-4c82-4134-93b3-8761a9be581f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.253864 Apr 09 02:00:55.912746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 375/748] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:55 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:55.937956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3050cc45-b10b-4cfa-8966-93b40f67516c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 25425 microversion: 2.1 time: 0.159490 Apr 09 02:00:55.938701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 374/749] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:55 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 25425 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:56.627558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-cef1c0cc-d0c1-4f2b-9678-532355782208 req-5e052992-2bda-4405-9940-bdcfadba3ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd", "name": "network-vif-plugged", "status": "completed", "tag": "6ccc6b33-8ac8-4278-a8df-c08a6caf6b01"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:56.629420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:00:56.629420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:00:56.640321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-cef1c0cc-d0c1-4f2b-9678-532355782208 req-5e052992-2bda-4405-9940-bdcfadba3ff7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.640321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-cef1c0cc-d0c1-4f2b-9678-532355782208 req-5e052992-2bda-4405-9940-bdcfadba3ff7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.648088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:56.648960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:56.658050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-cef1c0cc-d0c1-4f2b-9678-532355782208 req-5e052992-2bda-4405-9940-bdcfadba3ff7 service nova] Creating event network-vif-plugged:6ccc6b33-8ac8-4278-a8df-c08a6caf6b01 for instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd on hv-cinder-78462 Apr 09 02:00:56.658510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.659102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.660223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.660804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.663239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-cef1c0cc-d0c1-4f2b-9678-532355782208 req-5e052992-2bda-4405-9940-bdcfadba3ff7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Apr 09 02:00:56.664221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 376/750] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:00:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:00:56.720799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. Apr 09 02:00:56.721478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:00:56.722406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6bb245af-b335-496a-a106-9b141b9939a8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 404 len: 111 microversion: 2.20 time: 0.079987 Apr 09 02:00:56.723049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 375/751] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:00:56 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 02:00:56.733221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a567f6c5-fe15-4b3e-8ecc-4106a00dc245 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '.version_select at 0x7f966e6f7e18>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:56.756824 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a567f6c5-fe15-4b3e-8ecc-4106a00dc245 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218227359" status: 204 len: 0 microversion: 2.20 time: 0.028085 Apr 09 02:00:56.758043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 377/752] 10.222.0.38 () {60 vars in 1249 bytes} [Fri Apr 9 02:00:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218227359 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 02:00:56.937704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:56.939068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:56.953912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:56.955089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:56.960515 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.961437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.963022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.963882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.964280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.964802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:56.965727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:56.966155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:57.113710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c463a8e1-97ba-433a-a7af-b0729c090bc9 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 26797 microversion: 2.1 time: 0.162309 Apr 09 02:00:57.116026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 378/753] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:56 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 26797 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:57.250845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:57.261314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a34b5a02-18fa-4299-a2df-eaef60280ecc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.332911 Apr 09 02:00:57.262329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 376/754] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:56 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:58.135007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:58.136961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:58.151124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:58.151884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:58.153108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:58.155485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:58.198139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: .version_select at 0x7f9671dd5730>, body: {"keypair": {"name": "tempest-keypair-497645962"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:58.227203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:58.232982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:58.362248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-242ad836-9521-4fa5-b847-380768154d6d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 27518 microversion: 2.1 time: 0.235871 Apr 09 02:00:58.368472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 379/755] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:58 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 27518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:00:58.372628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:58.374183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:58.388443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:58.389129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:58.390462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:58.391111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:58.409658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:00:58.414636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:00:58.433181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1aeb9b9a-f1ef-4db8-a125-74b69d8d2ad0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.239829 Apr 09 02:00:58.435062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 377/756] 10.222.0.38 () {62 vars in 1189 bytes} [Fri Apr 9 02:00:58 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 243 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 09 02:00:58.611117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:58.620712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9318a5e8-ee16-4995-8556-2acbed518ab2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1265 microversion: 2.1 time: 0.255519 Apr 09 02:00:58.621290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 380/757] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:58 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:59.378410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:00:59.379757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:59.394067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.394559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:59.395415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.395903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:59.530184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-43295a61-41aa-4a6e-826c-ae06cc33bdfc tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28003 microversion: 2.1 time: 0.156053 Apr 09 02:00:59.530844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 378/758] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:00:59 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28003 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 02:00:59.640915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:59.641636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:59.650840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.651353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:59.652293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.652796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:59.913046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:00:59.929165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ea7aa5b8-80d0-4896-b23f-239978e68d23 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1452 microversion: 2.1 time: 0.293843 Apr 09 02:00:59.929821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 381/759] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:59 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1452 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:00:59.947410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:00:59.948224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:00:59.957778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.958274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:00:59.959165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:00:59.959584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:00.194722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:00.204940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6a12943b-e325-41ad-ab2f-9361aa8d4a50 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1452 microversion: 2.1 time: 0.262037 Apr 09 02:01:00.212030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 379/760] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:00:59 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:01:00.543732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:00.545112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:00.554082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:00.554640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:00.555546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:00.556141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:00.698739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a0411b5e-189a-4ccf-8c6f-ac0cbf6be7c4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28190 microversion: 2.1 time: 0.159229 Apr 09 02:01:00.699768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 382/761] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:00 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28190 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:01.145761 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-60323100", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef903f2c-70db-4778-a505-57ac9ff39c7e"}], "security_groups": [{"name": "tempest-securitygroup--663259507"}], "key_name": "tempest-keypair-497645962", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:01.299492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] validate_networks() for [('ef903f2c-70db-4778-a505-57ac9ff39c7e', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:01:01.712148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:01.713301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:01.722248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:01.722837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:01.723592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:01.724132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:01.874104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0b23e3fa-824a-4308-ac4f-66180f2d72a5 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28481 microversion: 2.1 time: 0.165005 Apr 09 02:01:01.887036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 383/762] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:01 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28481 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:02.480481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:01:02.480958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:01:02.481536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:01:02.482580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:01:02.483054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:01:02.493960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:02.494740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:02.496100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:02.497060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:02.536949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for project bf455ad3606b44cea681dcfebb803125. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:01:02.547890 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Getting quotas for user 051f419a8be54277a9ded252bd114bb7 and project bf455ad3606b44cea681dcfebb803125. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:01:02.562023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:01:02.564799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:01:02.644909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7b6ca115-db16-436a-9da3-8466d7fba972 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.502933 Apr 09 02:01:02.646468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 380/763] 10.222.0.38 () {62 vars in 1178 bytes} [Fri Apr 9 02:01:01 2021] POST /compute/v2.1/servers => generated 401 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 09 02:01:02.659804 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:02.662145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:02.764276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:02.773467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:02.775082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:02.776550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6f5a580b-87b8-4762-99d3-242ccf8767e2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1279 microversion: 2.20 time: 0.122483 Apr 09 02:01:02.777090 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 384/764] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:02 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:02.901495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:02.904126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:02.927232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:02.928198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:02.929794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:02.930925 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:03.130538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bc40f5cb-4b3c-4d2e-893d-c2c32480b420 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28649 microversion: 2.1 time: 0.238137 Apr 09 02:01:03.132345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 381/765] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:02 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28649 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:03.797055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:03.797796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:03.807452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:03.807963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:03.808879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:03.809356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:04.104556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:04.120140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:04.121940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:04.123327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d5b47904-20ad-4910-9f93-ec7878387688 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1339 microversion: 2.20 time: 0.331053 Apr 09 02:01:04.123964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 385/766] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:03 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1339 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:04.144085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:04.145374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:04.154476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:04.154979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:04.155819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:04.156332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:04.300512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-857eb02d-006b-4047-9c74-016f3f82000f tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28649 microversion: 2.1 time: 0.160713 Apr 09 02:01:04.301345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 382/767] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:04 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:04.984260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-b48f1b34-b378-44bd-a1d8-8a36689a665d req-85d7ad73-d7cb-4886-bb4c-764d91e27f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd", "tag": "6ccc6b33-8ac8-4278-a8df-c08a6caf6b01"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:04.986218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:01:04.986218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:01:04.995289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b48f1b34-b378-44bd-a1d8-8a36689a665d req-85d7ad73-d7cb-4886-bb4c-764d91e27f1f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:04.995789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-b48f1b34-b378-44bd-a1d8-8a36689a665d req-85d7ad73-d7cb-4886-bb4c-764d91e27f1f service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:05.013813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-b48f1b34-b378-44bd-a1d8-8a36689a665d req-85d7ad73-d7cb-4886-bb4c-764d91e27f1f service nova] Creating event network-changed:6ccc6b33-8ac8-4278-a8df-c08a6caf6b01 for instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd on hv-cinder-78462 Apr 09 02:01:05.019024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-b48f1b34-b378-44bd-a1d8-8a36689a665d req-85d7ad73-d7cb-4886-bb4c-764d91e27f1f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042551 Apr 09 02:01:05.019962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 386/768] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:05.147718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:05.148552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:05.158394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:05.159181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:05.160050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:05.160511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:05.314276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:05.316260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:05.324449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:05.325048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:05.326512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:05.327089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:05.340284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:05.355061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:05.357578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:05.359273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-84379a4e-2c75-4fd5-b889-285d6ddc02cd tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1337 microversion: 2.20 time: 0.216433 Apr 09 02:01:05.360545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 383/769] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:05 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1337 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:05.476599 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9d7d2956-5d40-455a-82f9-3d71d9309b0c tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28649 microversion: 2.1 time: 0.166606 Apr 09 02:01:05.477306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 387/770] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:05 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28649 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:06.382336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:06.383848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:06.395277 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:06.396040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:06.397060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:06.397732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:06.491078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:06.492228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:06.502684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:06.504723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:06.505783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:06.506525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:06.658046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-258c2699-2f0b-42cf-ad0e-684e10ec7ab6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 28649 microversion: 2.1 time: 0.171672 Apr 09 02:01:06.658792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 388/771] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:06 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 28649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:07.083136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:07.092962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:07.094617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:07.095796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6fc9abcd-1efc-48bf-a417-303bfe39c646 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.719423 Apr 09 02:01:07.096435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 384/772] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:06 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:07.673161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:07.674306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:07.682949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:07.683449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:07.684310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:07.685066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:07.818295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42d5878a-2ef7-4e38-9268-35bb187ba329 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 30733 microversion: 2.1 time: 0.150566 Apr 09 02:01:07.819000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 389/773] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:07 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 30733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:08.032162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-e1fa4a96-374c-4a99-a7cf-13ee2943bba8 req-c600fd91-a83f-4f1a-8fee-5f99f9143995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:08.033860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:01:08.033860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:01:08.043489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-e1fa4a96-374c-4a99-a7cf-13ee2943bba8 req-c600fd91-a83f-4f1a-8fee-5f99f9143995 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:08.044011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-e1fa4a96-374c-4a99-a7cf-13ee2943bba8 req-c600fd91-a83f-4f1a-8fee-5f99f9143995 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:08.062279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-e1fa4a96-374c-4a99-a7cf-13ee2943bba8 req-c600fd91-a83f-4f1a-8fee-5f99f9143995 service nova] Creating event network-changed:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:01:08.067272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-e1fa4a96-374c-4a99-a7cf-13ee2943bba8 req-c600fd91-a83f-4f1a-8fee-5f99f9143995 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039694 Apr 09 02:01:08.068144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 385/774] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:08.117205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:08.118426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:08.128978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:08.129636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:08.130490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:08.130980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:08.496376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:08.507724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:08.509876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:08.511132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e3a96262-b5d0-4b35-952e-aad492ef8647 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.398781 Apr 09 02:01:08.512796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 390/775] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:08 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:08.831468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:08.832720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:08.841401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:08.841909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:08.842763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:08.843306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:08.996880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1a72b422-ec42-4585-99cc-67b2f0539da7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 32498 microversion: 2.1 time: 0.170338 Apr 09 02:01:08.998443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 386/776] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:08 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 32498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:09.532546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:09.533216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:09.541696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:09.542205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:09.543024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:09.543511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:09.942328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:09.952767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:09.954450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:09.955787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-827886f7-4071-45ba-99ff-fab6a31d4e02 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.427978 Apr 09 02:01:09.956433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 391/777] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:09 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 02:01:10.012957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:10.014655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:10.024245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:10.024748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:10.025598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:10.026091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:10.161578 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-be562957-d0e3-4999-8211-f709f647b926 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 33314 microversion: 2.1 time: 0.153672 Apr 09 02:01:10.162909 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 387/778] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:10 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 33314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:10.980783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:10.981448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:10.990375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:10.990896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:10.991806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:10.992278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:11.175687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:11.177041 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:11.185778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:11.186285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:11.187150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:11.187642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:11.190516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:11.200338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:11.202524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:11.203715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1d4a239b-6d3b-4f3b-952e-4d491e70de10 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.227135 Apr 09 02:01:11.204406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 392/779] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:10 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:11.342618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a15c5813-4422-4817-84a0-dc90215b37f1 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 34062 microversion: 2.1 time: 0.170770 Apr 09 02:01:11.343863 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 388/780] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:11 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 34062 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:12.223652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:12.224371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:12.233436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:12.233953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:12.234797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:12.235552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:12.356217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:12.363960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:12.373007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:12.373848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:12.374354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:12.374844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:12.448836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:12.459194 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:12.461044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:12.462143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eccebb6d-d31f-4817-baf6-36e05fff8559 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.242653 Apr 09 02:01:12.462811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 393/781] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:12 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:12.516066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f570030a-908c-438d-b098-0144375b7d16 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 35087 microversion: 2.1 time: 0.163992 Apr 09 02:01:12.520608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 389/782] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:12 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 35087 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:12.557905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-1b455863-8c20-4793-9de3-4e8b3631d8ca req-47a84606-ef5a-41f2-af8f-75eb8d1deb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "name": "network-vif-plugged", "status": "completed", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:12.561427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:01:12.561427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:01:12.580104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1b455863-8c20-4793-9de3-4e8b3631d8ca req-47a84606-ef5a-41f2-af8f-75eb8d1deb11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:12.581005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1b455863-8c20-4793-9de3-4e8b3631d8ca req-47a84606-ef5a-41f2-af8f-75eb8d1deb11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:12.624296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-1b455863-8c20-4793-9de3-4e8b3631d8ca req-47a84606-ef5a-41f2-af8f-75eb8d1deb11 service nova] Creating event network-vif-plugged:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:01:12.634285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-1b455863-8c20-4793-9de3-4e8b3631d8ca req-47a84606-ef5a-41f2-af8f-75eb8d1deb11 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079933 Apr 09 02:01:12.635501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 394/783] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:13.483758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:13.484549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:13.493797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:13.494304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:13.495174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:13.495660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:13.529813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:13.531008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:13.539145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:13.539643 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:13.540529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:13.541020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:13.688667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-94a4f212-c739-43f6-82a8-096f446949e3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 36235 microversion: 2.1 time: 0.163203 Apr 09 02:01:13.689383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 395/784] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:13 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 36235 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:13.699688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:13.709414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:13.711079 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:13.712281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7282fd70-93c8-41b6-aaf3-5da5b352803b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1404 microversion: 2.20 time: 0.233744 Apr 09 02:01:13.712907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 390/785] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:13 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:14.703290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:14.704474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:14.713233 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:14.713733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:14.714574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:14.715055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:14.732999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:14.733675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:14.742414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:14.742921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:14.743766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:14.744285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:14.850689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d33686ec-27e2-4fb7-a345-875ac19d7363 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 37393 microversion: 2.1 time: 0.151835 Apr 09 02:01:14.855587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 396/786] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:14 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 37393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:15.088254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:15.098275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:15.099919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:15.101199 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-02975e7f-c155-4725-898c-e05ac685ae76 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1595 microversion: 2.20 time: 0.373206 Apr 09 02:01:15.101818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 391/787] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:14 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1595 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:01:15.121299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:15.121935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:15.130594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:15.131103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:15.131944 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:15.132457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:15.295286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9db00e7a-4b53-4c64-9f6e-deb66ea3a620 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.178501 Apr 09 02:01:15.295961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 397/788] 10.222.0.38 () {60 vars in 1306 bytes} [Fri Apr 9 02:01:15 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:15.864155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:15.865299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:15.874333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:15.876026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:15.876026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:15.876436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:16.023869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a280a765-e3f8-4ec6-87b4-e3b3312accc6 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 38176 microversion: 2.1 time: 0.163843 Apr 09 02:01:16.024655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 392/789] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:15 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 38176 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 09 02:01:17.037942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:17.038954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:17.047094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:17.047617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:17.048499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:17.048965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:17.077148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:17.078279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:17.087082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:17.087592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:17.088464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:17.088956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:17.215144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ccb0888d-6a14-451b-9fc8-5f410223543e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 38176 microversion: 2.1 time: 0.181492 Apr 09 02:01:17.216897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 398/790] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:17 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 38176 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:17.222060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-51bea5dd-48b2-49f8-aeb8-eb2eb108eeef req-74d40687-c10d-4f9f-991c-8d955cb1982d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:17.224237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:01:17.224237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:01:17.227842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42a433cf-f351-4714-b9ec-8a69e11940c2 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.154854 Apr 09 02:01:17.235866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-51bea5dd-48b2-49f8-aeb8-eb2eb108eeef req-74d40687-c10d-4f9f-991c-8d955cb1982d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:17.236145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-51bea5dd-48b2-49f8-aeb8-eb2eb108eeef req-74d40687-c10d-4f9f-991c-8d955cb1982d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:17.238332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 393/791] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:17 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:17.255620 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-51bea5dd-48b2-49f8-aeb8-eb2eb108eeef req-74d40687-c10d-4f9f-991c-8d955cb1982d service nova] Creating event network-changed:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:01:17.261353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-51bea5dd-48b2-49f8-aeb8-eb2eb108eeef req-74d40687-c10d-4f9f-991c-8d955cb1982d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Apr 09 02:01:17.262029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 399/792] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:01:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:18.229045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:18.230171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:18.240064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:18.240569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:18.241461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:18.241949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:18.244405 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:18.245527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:18.253955 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:18.254462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:18.255308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:18.255796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:18.384659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e0db6dbc-3357-489b-b8c7-9ae357a57e2e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 38176 microversion: 2.1 time: 0.160114 Apr 09 02:01:18.389001 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 394/793] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:18 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 38176 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:18.407376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-35b7ea70-9268-4986-aeaf-5a8e3f2c334a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.167692 Apr 09 02:01:18.408103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 400/794] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:18 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:01:19.397433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:19.398592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:19.407241 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.407796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.408630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.409121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.419902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:19.421159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:19.429689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.430176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.431012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.431510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.565948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3bfd19d2-dc62-4cb8-817e-9c119958fd11 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action" status: 200 len: 38305 microversion: 2.1 time: 0.172867 Apr 09 02:01:19.566651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 395/795] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:01:19 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/action => generated 38305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:19.577064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-86c1b701-2fd1-47b0-bbb3-b63ae5162e26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.162040 Apr 09 02:01:19.577864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 401/796] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:19 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:19.578086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:19.578711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:19.587252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.587751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.588595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:19.589080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:19.649231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b4ca8f76-8ff8-41e3-942c-42a23ede9fbf tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/ips" status: 200 len: 146 microversion: 2.1 time: 0.076030 Apr 09 02:01:19.649859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 396/797] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 02:01:19 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:01:20.589977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:20.591037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:20.599658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:20.600228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:20.601059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:20.601553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:20.727709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5a9f9489-4db7-412f-8f4b-7bbebf42e396 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.142283 Apr 09 02:01:20.728670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 402/798] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:20 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:01:21.161520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47ff084f-2d96-459b-bfea-62ee5a0a1ae5"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:21.162652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:21.172181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:21.172691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:21.173534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:21.174024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:21.561246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9f85e576-14b8-4f2e-b46e-5230a6246173 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403778 Apr 09 02:01:21.561963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 397/799] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 02:01:21 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:21.740525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:21.741812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:21.750740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:21.751253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:21.752173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:21.752671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:21.878488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8c86e139-6bc3-4e9d-8d7b-6abaad91e20c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.142632 Apr 09 02:01:21.879311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 403/800] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:21 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:22.891743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:22.893303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:22.906279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:22.906790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:22.907649 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:22.908170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:23.029411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7fefebba-6479-4647-aa23-6966f6158026 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.141978 Apr 09 02:01:23.030117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 398/801] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:22 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:24.041362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:24.042419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:24.051498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:24.052030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:24.052877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:24.053372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:24.179254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-af593949-428a-441c-83f9-6b87a438403b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.142315 Apr 09 02:01:24.179957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 404/802] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:24 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:25.192686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:25.193750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:25.203159 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:25.203667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:25.204539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:25.205027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:25.327265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7c5a68f2-3d43-452b-94a9-456094cb7d65 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 14 microversion: 2.20 time: 0.139135 Apr 09 02:01:25.327967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 399/803] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:25 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:26.340048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:26.341786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:26.350507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:26.351021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:26.351881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:26.352409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:26.490833 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7620c809-5456-4c7b-9508-ae6085931614 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 576 microversion: 2.20 time: 0.155221 Apr 09 02:01:26.491568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 405/804] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:26 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:27.505037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:27.506177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:27.516518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:27.517025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:27.517880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:27.518367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:27.671277 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9cd09f74-c36f-4384-9ddf-c77ea5ce7c26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 12724 microversion: 2.20 time: 0.171933 Apr 09 02:01:27.672338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 400/805] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:27 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 12724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:28.683968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:28.685319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:28.693792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:28.694290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:28.695112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:28.695596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:28.824737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d8b52493-660e-4406-b5ce-0e6ccbd3bf67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 18608 microversion: 2.20 time: 0.144907 Apr 09 02:01:28.825481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 406/806] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:28 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 18608 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:29.427229 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:29.428410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:29.437847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.438352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:29.439210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.439702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:29.517658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d3a2e9e4-f92f-49c1-90e1-1a3a6ed301ce tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095265 Apr 09 02:01:29.518304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 401/807] 10.222.0.38 () {58 vars in 1292 bytes} [Fri Apr 9 02:01:29 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:29.529848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:29.530477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:29.539358 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.539918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:29.540879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.541421 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:29.615026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-58a28f9d-26c5-406e-8d97-998c7603ae7b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5" status: 200 len: 194 microversion: 2.1 time: 0.089718 Apr 09 02:01:29.615669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 407/808] 10.222.0.38 () {58 vars in 1403 bytes} [Fri Apr 9 02:01:29 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:29.839003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:29.841375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:29.850332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.851207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:29.852531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:29.853253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:30.012655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b8ed0e79-57ea-4490-9c10-79f81f51cd13 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 19342 microversion: 2.20 time: 0.176256 Apr 09 02:01:30.012655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 402/809] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:29 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 19342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:31.026132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:31.027123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:31.035817 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:31.036374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:31.037245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:31.037743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:31.187467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-23be943f-1dcd-46ac-8214-f36c6156eb67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 22070 microversion: 2.20 time: 0.164718 Apr 09 02:01:31.189352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 408/810] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:31 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 22070 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:31.282390 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca9d12c7-8681-4ce3-a766-c0212a3049d3"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:31.284495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:31.298918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:31.299468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:31.300413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:31.300953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:31.744019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-228f3f23-cf55-4400-a266-ce3568b266f4 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466504 Apr 09 02:01:31.744691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 403/811] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 02:01:31 2021] POST /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:32.204444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:32.205584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:32.214886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:32.215457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:32.217030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:32.217566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:32.370470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a766a6b8-3b9d-4c09-bde5-f51b028f4dff tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 23439 microversion: 2.20 time: 0.171159 Apr 09 02:01:32.371302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 409/812] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:32 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 23439 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:33.384964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:33.386189 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:33.395700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:33.396248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:33.397120 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:33.397618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:33.542771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f5f7a373-c089-42d7-9466-45026e5431e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 25099 microversion: 2.20 time: 0.162911 Apr 09 02:01:33.543507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 404/813] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:33 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 25099 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:34.557155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:34.558314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:34.567762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:34.568383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:34.569296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:34.569846 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:34.716796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a75bbf2-2af1-4962-8494-2434e3b7fb59 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 26704 microversion: 2.20 time: 0.163487 Apr 09 02:01:34.717533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 410/814] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:34 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 26704 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:35.732351 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:35.733504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:35.752196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:35.752703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:35.753577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:35.754071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:35.888740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b184ca90-bbab-4c69-9c33-4532ab9f0653 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 27575 microversion: 2.20 time: 0.160916 Apr 09 02:01:35.893022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 405/815] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:35 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 27575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:36.901868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:36.903066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:36.912801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:36.913312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:36.914181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:36.914677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:37.057527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c4353d07-86e0-4cd0-9ab4-171fbb7aba26 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28014 microversion: 2.20 time: 0.160236 Apr 09 02:01:37.058268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 411/816] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:36 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28014 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:01:38.071630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:38.072798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:38.087015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:38.087509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:38.088446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:38.088938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:38.238739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-948811a3-3325-4d90-8b7c-3e2a1ccbe00a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28183 microversion: 2.20 time: 0.171470 Apr 09 02:01:38.239556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 406/817] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:38 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:39.254029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:39.255171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:39.264200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:39.264700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:39.265602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:39.266083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:39.405508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ea2b09fb-6809-4038-b10f-61c49d7326b3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28436 microversion: 2.20 time: 0.155853 Apr 09 02:01:39.406237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 412/818] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:39 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28436 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:39.658302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:39.659507 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:39.668500 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:39.669008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:39.669867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:39.670359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:39.745771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-064871b9-ea5e-414c-a53f-3c022907e6b3 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.092883 Apr 09 02:01:39.746418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 407/819] 10.222.0.38 () {58 vars in 1292 bytes} [Fri Apr 9 02:01:39 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:40.105691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:40.106450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:40.115973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.116616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.117490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.117979 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.189470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-002aa8ac-a27f-4184-9399-1da98a517a36 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5" status: 200 len: 194 microversion: 2.1 time: 0.088475 Apr 09 02:01:40.190063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 413/820] 10.222.0.38 () {58 vars in 1403 bytes} [Fri Apr 9 02:01:40 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:40.201513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:40.202060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:40.210282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.210790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.211651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.212171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.397762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lazy-loading 'services' on Instance uuid 8f92def9-b701-4c5a-b5bf-935d452a5f01 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:01:40.419539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:40.420640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:40.428922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.429465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.430284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:40.430766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:40.569481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-00547933-3a7b-4d7b-9e73-8acc9ca45e79 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28642 microversion: 2.20 time: 0.154851 Apr 09 02:01:40.570217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 414/821] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:40 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28642 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:01:40.618695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-04b1b391-9bb9-42ee-97dc-50f4cda1b0d2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5" status: 202 len: 0 microversion: 2.1 time: 0.421671 Apr 09 02:01:40.619615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 408/822] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 02:01:40 2021] DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/47ff084f-2d96-459b-bfea-62ee5a0a1ae5 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:41.585219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:41.586404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:41.595532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:41.596048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:41.596906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:41.597448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:41.729773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-92713b36-3df6-4d62-86b4-e7359e87a044 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28642 microversion: 2.20 time: 0.149178 Apr 09 02:01:41.730487 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 415/823] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:41 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28642 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:42.743116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:42.744292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:42.753153 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:42.753668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:42.754518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:42.755012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:42.885921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-254d5ee7-442e-405c-a6d0-8042db389a75 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28642 microversion: 2.20 time: 0.147156 Apr 09 02:01:42.887379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 409/824] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:42 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28642 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:42.967536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:42.968218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:42.977339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:42.977849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:42.978711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:42.979207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:43.194333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ec5216f5-fee6-4656-8ed6-9fd273fc72d7 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/ca9d12c7-8681-4ce3-a766-c0212a3049d3" status: 200 len: 194 microversion: 2.1 time: 0.231372 Apr 09 02:01:43.194910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 416/825] 10.222.0.38 () {58 vars in 1403 bytes} [Fri Apr 9 02:01:42 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/ca9d12c7-8681-4ce3-a766-c0212a3049d3 => generated 194 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:01:43.206918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:43.207559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:43.217446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:43.217953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:43.218796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:43.219285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:43.394916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lazy-loading 'services' on Instance uuid 8f92def9-b701-4c5a-b5bf-935d452a5f01 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:01:43.545935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6166bc85-7fc1-4ce1-8c2c-0e979e0f7c02 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/ca9d12c7-8681-4ce3-a766-c0212a3049d3" status: 202 len: 0 microversion: 2.1 time: 0.343412 Apr 09 02:01:43.546604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 410/826] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 02:01:43 2021] DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01/os-volume_attachments/ca9d12c7-8681-4ce3-a766-c0212a3049d3 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:44.050998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:44.052857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:44.069062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:44.069980 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:44.071579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:44.072700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:44.237795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-59626287-e9f7-4606-8139-090ebaa5ca8f tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 28642 microversion: 2.20 time: 0.340323 Apr 09 02:01:44.238481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 417/827] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:43 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 28642 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:01:45.210668 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:45.211848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:45.228237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.229172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.230762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.232393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.251309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:45.252583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:45.261549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.262049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.262891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.263375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.330270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:01:45.397222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b970bcc3-b990-4d75-8674-53b74b51023a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 30700 microversion: 2.20 time: 0.150144 Apr 09 02:01:45.397872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 418/828] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:45 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 30700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:01:45.466587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-571af40e-8aa1-462d-a565-48e8dab4cf81 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 204 len: 0 microversion: 2.1 time: 0.264644 Apr 09 02:01:45.467692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 411/829] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:01:45 2021] DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:01:45.477967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:45.478795 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:45.488976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.489490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.490354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:45.490861 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:45.695526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:45.705808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-66a09994-8247-489c-88bb-ccdeb0d7b8c2 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1672 microversion: 2.1 time: 0.232441 Apr 09 02:01:45.706457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 419/830] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:45 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:46.411712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:46.412897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:46.421995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:46.422490 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:46.423345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:46.423828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:46.557230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7c73e922-84df-461f-bd48-b17ffb0f89ec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 32513 microversion: 2.20 time: 0.150121 Apr 09 02:01:46.557993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 412/831] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:46 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 32513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:46.725400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:46.726071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:46.735941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:46.736504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:46.737491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:46.737987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:46.946624 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:46.956596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96d92b16-235d-4e2c-b8f0-0415473f506d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1672 microversion: 2.1 time: 0.235243 Apr 09 02:01:46.957407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 420/832] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:46 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:47.572191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:47.573488 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:47.582605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:47.583113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:47.584045 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:47.584510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:47.718496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fec7f9e8-fda7-4606-b2cd-c58ac50d390b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 33560 microversion: 2.20 time: 0.151438 Apr 09 02:01:47.719520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 413/833] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:47 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 33560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:47.991406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:47.992809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:48.007496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:48.008437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:48.009976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:48.010892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:48.433983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:48.444913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8c9327b9-bf40-4611-b403-cfd23ea0b77e tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1672 microversion: 2.1 time: 0.461858 Apr 09 02:01:48.445677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 421/834] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:47 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1672 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:48.731255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:48.732464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:48.744494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:48.745063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:48.745998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:48.746592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:48.889009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3f4901a9-0173-4a6d-a52d-2170e985228b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 34848 microversion: 2.20 time: 0.162095 Apr 09 02:01:48.894207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 414/835] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:48 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 34848 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:49.472416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:49.474119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:49.491174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:49.492148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:49.493765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:49.494717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:49.680753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-4fb5a5b5-bb7d-4233-9923-3cf2d61e5f23 req-8cbe61ab-6af0-46de-845f-245c7fca0ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f92def9-b701-4c5a-b5bf-935d452a5f01", "name": "network-vif-deleted", "tag": "4f9e1053-02e4-41a2-810b-44dbe3882f43"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:49.682977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:01:49.682977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:01:49.696267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4fb5a5b5-bb7d-4233-9923-3cf2d61e5f23 req-8cbe61ab-6af0-46de-845f-245c7fca0ba7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:49.696973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-4fb5a5b5-bb7d-4233-9923-3cf2d61e5f23 req-8cbe61ab-6af0-46de-845f-245c7fca0ba7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:49.721416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-4fb5a5b5-bb7d-4233-9923-3cf2d61e5f23 req-8cbe61ab-6af0-46de-845f-245c7fca0ba7 service nova] Creating event network-vif-deleted:4f9e1053-02e4-41a2-810b-44dbe3882f43 for instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 on hv-cinder-78462 Apr 09 02:01:49.730778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-4fb5a5b5-bb7d-4233-9923-3cf2d61e5f23 req-8cbe61ab-6af0-46de-845f-245c7fca0ba7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054436 Apr 09 02:01:49.732530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 415/836] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:01:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:01:49.748759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf95307e0f04775b0fcd89f870184c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04741939d3534ea99b01d960cf92f527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:49.760428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6ac1a408-a340-4d86-8bd2-71fd08a0d890 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 200 len: 1605 microversion: 2.1 time: 0.296223 Apr 09 02:01:49.761637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 422/837] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:49 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 1605 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:01:49.907871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:49.909102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:49.918443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:49.919499 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:49.920426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:49.925052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:50.073116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-25f4664d-63d9-4626-b918-2305a28bb89d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 36149 microversion: 2.20 time: 0.172653 Apr 09 02:01:50.074469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 416/838] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:49 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 36149 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:50.781184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:50.781869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:50.790020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:50.790529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:50.791387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:50.791882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:50.869707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. Apr 09 02:01:50.870962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:01:50.873343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4aad26dc-ef19-436c-9269-b61664f0a29a tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 404 len: 111 microversion: 2.1 time: 0.096282 Apr 09 02:01:50.874637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 423/839] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:50 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:01:50.886590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1a5a14ea-e8dc-44a7-a849-ce97cac34440 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '.version_select at 0x7f966de317b8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:50.912178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1a5a14ea-e8dc-44a7-a849-ce97cac34440 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220531237" status: 202 len: 0 microversion: 2.1 time: 0.030083 Apr 09 02:01:50.913798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 417/840] 10.222.0.38 () {58 vars in 1208 bytes} [Fri Apr 9 02:01:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220531237 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:51.088718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:51.089779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:51.097898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:51.098408 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:51.099271 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:51.099766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:51.240192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ece29cbb-bc4a-4527-8783-4846cc18328d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 37916 microversion: 2.20 time: 0.155618 Apr 09 02:01:51.244796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 424/841] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:51 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 37916 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:52.254412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:52.255657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:52.265811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:52.266311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:52.267183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:52.267673 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:52.404146 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-856be7c3-844a-4690-a03f-a80b20848b03 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 38183 microversion: 2.20 time: 0.153688 Apr 09 02:01:52.406213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 418/842] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:52 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 38183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:53.419836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:53.421024 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:53.429916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:53.430428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:53.431291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:53.431805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:53.561442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8e145dde-eee1-4733-9bed-2f29e239d31a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 38183 microversion: 2.20 time: 0.146149 Apr 09 02:01:53.562172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 425/843] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:53 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 38183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:54.576388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:54.577556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:54.586845 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:54.587350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:54.588228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:54.588723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:54.716179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-564783b4-6849-4f64-8ae1-776e965f6260 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 38183 microversion: 2.20 time: 0.144473 Apr 09 02:01:54.716951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 419/844] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:54 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 38183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:01:55.662788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:55.663446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:55.672606 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.673103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.673935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.674426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.727292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. Apr 09 02:01:55.727953 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:01:55.728898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-87cd3381-06e0-4ed5-8a15-990a1ad2510d tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 404 len: 111 microversion: 2.1 time: 0.070645 Apr 09 02:01:55.729513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 426/845] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:01:55 2021] DELETE /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:01:55.729935 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:55.731708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:55.738696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:55.739368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 8f92def9-b701-4c5a-b5bf-935d452a5f01] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:55.741130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.741629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.742481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.742969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.747242 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.747738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.748609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.749098 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.802453 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. Apr 09 02:01:55.803114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 8f92def9-b701-4c5a-b5bf-935d452a5f01 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:01:55.804029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e996b2ab-8258-464b-8fcb-88811482eadb tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01" status: 404 len: 111 microversion: 2.1 time: 0.069629 Apr 09 02:01:55.804659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 427/846] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:55 2021] GET /compute/v2.1/servers/8f92def9-b701-4c5a-b5bf-935d452a5f01 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 02:01:55.869107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-413a6109-0387-4c4a-bcb1-007fea3a34a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 200 len: 38322 microversion: 2.20 time: 0.143550 Apr 09 02:01:55.870834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 420/847] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:55 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 38322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:01:55.880864 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:55.881893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:55.890978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.891609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.892572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:55.893261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:55.963449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bbbef0d0-b2e7-483a-8bee-4a0a2c9a1d36 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/ips" status: 200 len: 151 microversion: 2.20 time: 0.086725 Apr 09 02:01:55.964118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 428/848] 10.222.0.38 () {60 vars in 1279 bytes} [Fri Apr 9 02:01:55 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/ips => generated 151 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:01:57.063223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:57.063870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:57.072721 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:57.073231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:57.074075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:57.074572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:57.129354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. Apr 09 02:01:57.130022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:01:57.130933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-955d70c3-7ed9-4bf3-84c6-cb693ff44b0b tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 404 len: 111 microversion: 2.1 time: 0.073282 Apr 09 02:01:57.131595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 421/849] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:01:57 2021] DELETE /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:01:57.140173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:57.140847 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] [instance: 7113ca87-3a31-415b-b770-e7f4ce41b0cc] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:57.149397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:57.149854 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:57.150699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:57.151198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:57.206077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] HTTP exception thrown: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. Apr 09 02:01:57.206758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] Returning 404 to user: Instance 7113ca87-3a31-415b-b770-e7f4ce41b0cc could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:01:57.207679 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ade3a476-0468-4436-a0cd-f0034b505358 tempest-AttachVolumeTestJSON-1574516603 tempest-AttachVolumeTestJSON-1574516603-project] 10.222.0.38 "GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc" status: 404 len: 111 microversion: 2.1 time: 0.071602 Apr 09 02:01:57.208345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 429/850] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:01:57 2021] GET /compute/v2.1/servers/7113ca87-3a31-415b-b770-e7f4ce41b0cc => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:01:58.181105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:01:58.181703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:58.191026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:58.191538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:58.192448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:58.192947 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:58.260258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lazy-loading 'flavor' on Instance uuid 9c7e7822-32d3-49f3-9878-3d61727a65ee {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:01:58.679397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a275e16-e848-455a-a910-4d74587ddc9a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 202 len: 0 microversion: 2.20 time: 0.502682 Apr 09 02:01:58.680413 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 422/851] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:01:58 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 09 02:01:58.690365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:01:58.690942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:01:58.699710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:58.700276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:58.701119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:01:58.701782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:01:59.449363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:59.462782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:59.464478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:01:59.465752 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b59a0da-8624-4805-a22c-e1200e3ffaa7 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.779967 Apr 09 02:01:59.466372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 430/852] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:01:58 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:00.488493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:00.489399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:00.498306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:00.498814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:00.499669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:00.500215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:00.870443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:00.880797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:00.883065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:00.884386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-894d4725-15f1-46d3-ba71-97f8345d7de8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.401472 Apr 09 02:02:00.884972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 423/853] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:00 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:01.906267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:01.907694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:01.916008 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:01.916522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:01.917424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:01.917923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:02.180871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:02.190311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:02.192039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:02.193267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0d68559e-864f-4964-99fd-bc7321ff6a9e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.291522 Apr 09 02:02:02.197056 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 431/854] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:01 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:03.217654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:03.218371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:03.226874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:03.227385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:03.228286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:03.228779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:03.593583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:03.603236 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:03.604946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:03.606259 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6decedcd-6bbb-4ffb-8ab3-c114935defec tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.393342 Apr 09 02:02:03.606952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 424/855] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:03 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:04.627460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:04.628341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:04.637312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:04.637823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:04.638684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:04.639177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:05.133939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:05.158266 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:05.159871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:05.161565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8506b6c2-42cb-4922-a987-9cef564e4504 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.538275 Apr 09 02:02:05.162071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 432/856] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:04 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:06.180806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:06.181486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:06.190132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:06.190626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:06.191450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:06.191929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:06.390956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:06.400406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:06.402054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:06.403755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b3b94468-3ca2-4ac8-bffb-13e569af4533 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.227163 Apr 09 02:02:06.404397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 425/857] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:06 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:06.931684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fb153315-8091-456e-9ca5-0b683db45568 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Action: 'create', calling method: .version_select at 0x7f966de6cb70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1775071000", "metadata": {"Type": "work"}}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:06.933342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fb153315-8091-456e-9ca5-0b683db45568 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:06.934780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fb153315-8091-456e-9ca5-0b683db45568 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.156057 Apr 09 02:02:06.935373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 433/858] 10.222.0.38 () {60 vars in 1146 bytes} [Fri Apr 9 02:02:06 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 02:02:06.945269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2cf4f41-f7bd-4ff2-a0c3-578de5726c91 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Action: 'create', calling method: .version_select at 0x7f966d3b2c80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-840780158", "metadata": {"Type": "work"}}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:06.946973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2cf4f41-f7bd-4ff2-a0c3-578de5726c91 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:06.947867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2cf4f41-f7bd-4ff2-a0c3-578de5726c91 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006766 Apr 09 02:02:06.948468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 426/859] 10.222.0.38 () {60 vars in 1146 bytes} [Fri Apr 9 02:02:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 02:02:06.959049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bdfbaedf-a2c3-4950-9074-c5d723b885e4 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Action: 'create', calling method: .version_select at 0x7f966c7b5378>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1813086644", "metadata": {"Type": "work"}}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:06.960418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bdfbaedf-a2c3-4950-9074-c5d723b885e4 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:06.961296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bdfbaedf-a2c3-4950-9074-c5d723b885e4 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006411 Apr 09 02:02:06.961887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 434/860] 10.222.0.38 () {60 vars in 1146 bytes} [Fri Apr 9 02:02:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 09 02:02:06.971597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9477f493-1e65-4d82-a4bf-a5405a85b519 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Calling method '.version_select at 0x7f966de316a8>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:07.039332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-9477f493-1e65-4d82-a4bf-a5405a85b519 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] HTTP exception thrown: Volume tempest-invalid-1255323810 could not be found. Apr 09 02:02:07.040729 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9477f493-1e65-4d82-a4bf-a5405a85b519 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 404 to user: Volume tempest-invalid-1255323810 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:07.041629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9477f493-1e65-4d82-a4bf-a5405a85b519 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1255323810" status: 404 len: 99 microversion: 2.1 time: 0.074011 Apr 09 02:02:07.042226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 427/861] 10.222.0.38 () {58 vars in 1208 bytes} [Fri Apr 9 02:02:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1255323810 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 09 02:02:07.052789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b9206984-ae00-4b3c-aa68-ed4ce174b5bf tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004738 Apr 09 02:02:07.053347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 435/862] 10.222.0.38 () {58 vars in 1130 bytes} [Fri Apr 9 02:02:07 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 02:02:07.062942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ced9b143-e9dc-44d9-ac0d-c4bd33981a95 tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004416 Apr 09 02:02:07.063532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 428/863] 10.222.0.38 () {58 vars in 1127 bytes} [Fri Apr 9 02:02:07 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 09 02:02:07.072574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b335272d-cad4-4c1b-91c6-4b22b51e56fa tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Calling method '.version_select at 0x7f966c7b5bf8>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:07.140803 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b335272d-cad4-4c1b-91c6-4b22b51e56fa tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] HTTP exception thrown: Volume 9ffcd7f3-137f-40cb-afd2-d7ad2ef5e0a5 could not be found. Apr 09 02:02:07.141478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b335272d-cad4-4c1b-91c6-4b22b51e56fa tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 404 to user: Volume 9ffcd7f3-137f-40cb-afd2-d7ad2ef5e0a5 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:07.142601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b335272d-cad4-4c1b-91c6-4b22b51e56fa tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/9ffcd7f3-137f-40cb-afd2-d7ad2ef5e0a5" status: 404 len: 109 microversion: 2.1 time: 0.073725 Apr 09 02:02:07.142997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 436/864] 10.222.0.38 () {58 vars in 1238 bytes} [Fri Apr 9 02:02:07 2021] DELETE /compute/v2.1/os-volumes/9ffcd7f3-137f-40cb-afd2-d7ad2ef5e0a5 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:02:07.152790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b815976-2581-4bed-bc85-43237131cafe tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Calling method '.version_select at 0x7f966d3b2ea0>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:07.216967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-4b815976-2581-4bed-bc85-43237131cafe tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] HTTP exception thrown: Volume 9fb33687-ccf5-4f78-b3d4-d809e2bfe446 could not be found. Apr 09 02:02:07.217647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b815976-2581-4bed-bc85-43237131cafe tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] Returning 404 to user: Volume 9fb33687-ccf5-4f78-b3d4-d809e2bfe446 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:02:07.218541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b815976-2581-4bed-bc85-43237131cafe tempest-VolumesNegativeTest-2019005673 tempest-VolumesNegativeTest-2019005673-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/9fb33687-ccf5-4f78-b3d4-d809e2bfe446" status: 404 len: 109 microversion: 2.1 time: 0.069811 Apr 09 02:02:07.219185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 429/865] 10.222.0.38 () {58 vars in 1235 bytes} [Fri Apr 9 02:02:07 2021] GET /compute/v2.1/os-volumes/9fb33687-ccf5-4f78-b3d4-d809e2bfe446 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:02:07.423444 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:07.424231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:07.435391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:07.435898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:07.436769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:07.437281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:07.649977 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:07.660625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:07.662299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:07.663534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d8830df1-aedb-4cd8-9d66-a46bffd8aaa0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.244253 Apr 09 02:02:07.664173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 437/866] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:07 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:08.683015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:08.684924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:08.692932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:08.693418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:08.694256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:08.694749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:08.894719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:08.907905 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:08.909654 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:08.910895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ee019967-fee7-4e7f-afb4-aee071258640 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.232003 Apr 09 02:02:08.911523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 430/867] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:08 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:09.930543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:09.931212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:09.939379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:09.939891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:09.940779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:09.941273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:10.212474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:10.222735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:10.224449 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:10.225698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-31fb7f90-9793-4fad-af04-d678bf0269aa tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1741 microversion: 2.20 time: 0.299350 Apr 09 02:02:10.226337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 438/868] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:09 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:11.248687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:11.249361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:11.258443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:11.259270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:11.260314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:11.260809 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:11.469220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:11.479856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:11.493122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:11.494393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-323db0b1-7b62-4045-9c3d-ab879ef84285 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.251694 Apr 09 02:02:11.494986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 431/869] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:11 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:12.516941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:12.518999 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:12.552639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:12.553273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:12.554338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:12.554830 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:12.830868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:12.846822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:12.849055 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:12.850819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a40e44ef-3006-4cc6-8d88-f20a154871e6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.339746 Apr 09 02:02:12.852559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 439/870] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:12 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:13.871034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:13.871874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:13.884974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:13.885478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:13.886346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:13.886875 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:14.115693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:14.128119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:14.130276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:14.131798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-97f552e9-7732-45b2-983d-bd93e66bfb07 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.264752 Apr 09 02:02:14.132848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 432/871] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:13 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:14.915264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d4bb2301-2eb9-41ce-8169-ab7bc28c3bc1 req-8c34ea08-c726-4ee4-962c-0bd4088a92a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "name": "network-vif-plugged", "status": "completed", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:14.917321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:02:14.917321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:02:14.939077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d4bb2301-2eb9-41ce-8169-ab7bc28c3bc1 req-8c34ea08-c726-4ee4-962c-0bd4088a92a9 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:14.939866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d4bb2301-2eb9-41ce-8169-ab7bc28c3bc1 req-8c34ea08-c726-4ee4-962c-0bd4088a92a9 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:14.967149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d4bb2301-2eb9-41ce-8169-ab7bc28c3bc1 req-8c34ea08-c726-4ee4-962c-0bd4088a92a9 service nova] Creating event network-vif-plugged:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:02:14.995286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d4bb2301-2eb9-41ce-8169-ab7bc28c3bc1 req-8c34ea08-c726-4ee4-962c-0bd4088a92a9 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082361 Apr 09 02:02:14.995286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 440/872] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:02:15.154046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:15.157672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:15.169173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:15.170378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:15.171508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:15.172254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:15.407702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:15.419523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:15.421252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:15.422472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-95eb3c7f-483c-4f80-a37d-69bc20253489 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.273712 Apr 09 02:02:15.428835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 433/873] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:15 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:16.450123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:16.451493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:16.461561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:16.462344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:16.463415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:16.464151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:16.717067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:16.732503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:16.734456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:16.736170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-efe21216-7734-4eea-b0ec-99231c487007 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.290910 Apr 09 02:02:16.740642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 441/874] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:16 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:17.766489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:17.768843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:17.781481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:17.781481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:17.782769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:17.783651 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:18.088916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:18.103648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:18.106122 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:18.107392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2cace0d1-27bb-45f6-a4fb-5e503a425e67 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.352171 Apr 09 02:02:18.108302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 434/875] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:17 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:19.127723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:19.129077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:19.142656 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:19.144551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:19.145659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:19.146718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:19.409842 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:19.421031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:19.423099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:19.425171 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cffe8353-48de-463e-8e1f-e414775ee961 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.301424 Apr 09 02:02:19.426333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 442/876] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:19 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:20.445267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:20.446072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:20.455447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:20.456103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:20.457073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:20.457652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:20.679881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:20.691030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:20.692775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:20.694397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-67d3fa8c-c081-434c-839a-b76da6a08546 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.252895 Apr 09 02:02:20.695437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 435/877] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:20 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:21.714400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:21.715067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:21.723021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:21.723534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:21.724414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:21.724912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:21.925548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:21.935148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:21.936889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:21.938121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e8220a8c-fe64-469c-bd31-6725b0eb5dc0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1736 microversion: 2.20 time: 0.227879 Apr 09 02:02:21.938784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 443/878] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:21 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:22.958549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:22.959219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:22.967869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:22.968442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:22.969322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:22.970114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:23.229860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:23.240290 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:23.241940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:23.243166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-df74d648-3bf8-4d8c-887e-31600efa1b0c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1718 microversion: 2.20 time: 0.288808 Apr 09 02:02:23.243780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 436/879] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:22 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1718 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:24.263929 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:24.264716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:24.272794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:24.273286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:24.274129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:24.274617 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:24.483522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:24.494060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:24.495726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:24.497539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a40ef59-c5c5-48c4-990e-ef8b79764938 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1718 microversion: 2.20 time: 0.238480 Apr 09 02:02:24.498163 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 444/880] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:24 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:25.518300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:25.519038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:25.528401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:25.528918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:25.529792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:25.530285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:25.732796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:25.743495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:25.745204 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:25.746939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2500ea8-1e20-4e2b-af8d-bd44a0cfacbf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1661 microversion: 2.20 time: 0.232914 Apr 09 02:02:25.747568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 437/881] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:25 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1661 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 02:02:25.768033 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "201d1941-1831-4595-89b5-38091f987807"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:25.769205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:25.777856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:25.778366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:25.779221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:25.779724 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:26.227180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-85b0924b-4363-4125-a39c-519d4c984340 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.463299 Apr 09 02:02:26.227887 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 445/882] 10.222.0.38 () {62 vars in 1354 bytes} [Fri Apr 9 02:02:25 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-volume_attachments => generated 188 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 09 02:02:26.349252 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:26.349920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:26.362601 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:26.363819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:26.365671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:26.366327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:26.842044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5f5341ef-7adc-4415-a51e-a76345755374 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-volume_attachments/201d1941-1831-4595-89b5-38091f987807" status: 202 len: 0 microversion: 2.20 time: 0.497156 Apr 09 02:02:26.843354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 438/883] 10.222.0.38 () {60 vars in 1447 bytes} [Fri Apr 9 02:02:26 2021] DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/os-volume_attachments/201d1941-1831-4595-89b5-38091f987807 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:02:26.849127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-8b274205-cd84-4e9f-a655-81b55c8c356f req-a95f4feb-7bb9-4eba-bc08-d827d1e1ae3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "name": "network-vif-unplugged", "status": "completed", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:26.851457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:02:26.851457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:02:26.863614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8b274205-cd84-4e9f-a655-81b55c8c356f req-a95f4feb-7bb9-4eba-bc08-d827d1e1ae3d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:26.864511 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8b274205-cd84-4e9f-a655-81b55c8c356f req-a95f4feb-7bb9-4eba-bc08-d827d1e1ae3d service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:26.885789 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.compute.server_external_events [req-8b274205-cd84-4e9f-a655-81b55c8c356f req-a95f4feb-7bb9-4eba-bc08-d827d1e1ae3d service nova] Unable to find a host for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee. Dropping event network-vif-unplugged {{(pid=99349) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 09 02:02:26.887546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-8b274205-cd84-4e9f-a655-81b55c8c356f req-a95f4feb-7bb9-4eba-bc08-d827d1e1ae3d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044524 Apr 09 02:02:26.888452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 446/884] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 09 02:02:26.956568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:26.957196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:26.966117 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:26.966614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:26.967851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:26.968013 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:27.130365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-705aade6-d7b8-4d5e-98b8-0008331a4dc4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action" status: 202 len: 0 microversion: 2.20 time: 0.178658 Apr 09 02:02:27.131285 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 439/885] 10.222.0.38 () {62 vars in 1309 bytes} [Fri Apr 9 02:02:26 2021] POST /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:02:27.140508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:27.141176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:27.149238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:27.149756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:27.150739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:27.151087 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:27.374678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:27.385669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:27.387910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:27.389422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ca75d831-c543-4571-adff-4b427ea879e0 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1669 microversion: 2.20 time: 0.253500 Apr 09 02:02:27.390035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 447/886] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:27 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:28.410181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:28.411157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:28.426563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:28.428316 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:28.429738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:28.430302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:29.097145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:29.109141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:29.111279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:29.112703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2f64f515-9901-4bd2-9440-70257ffcf05d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1671 microversion: 2.20 time: 0.706825 Apr 09 02:02:29.113658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 440/887] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:28 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1671 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:30.137530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:30.138198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:30.146543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:30.147066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:30.150501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:30.150501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:30.362688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:30.372904 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:30.374563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:30.375787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b53b1fa-f3b8-495d-8364-c84b959724c5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.242958 Apr 09 02:02:30.376441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 448/888] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:30 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 09 02:02:31.396355 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:31.397023 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:31.406099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:31.406598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:31.407438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:31.407918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:31.682798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:31.693823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:31.695536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:31.696798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-87308856-5d96-42a3-8f4a-fb9b1f1333ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.304733 Apr 09 02:02:31.697634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 441/889] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:31 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:32.718248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:32.718990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:32.727190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:32.727961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:32.728996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:32.729652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:33.016886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:33.032989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:33.034825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:33.036253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2551ff86-e4fa-40bc-b27e-022b4b02b918 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.323134 Apr 09 02:02:33.036866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 449/890] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:32 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:34.069415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:34.070067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:34.079844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.080391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.081283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.081765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.275716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:34.276571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:34.286799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.287409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.288443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.289029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.333749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:34.345465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:34.347129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:34.348422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3eb8f63a-4e9f-48e1-8b21-760106330719 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.283376 Apr 09 02:02:34.349044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 442/891] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:34 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:34.366536 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lazy-loading 'flavor' on Instance uuid 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:02:34.567927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2dd2d7d2-b591-46ac-8f26-5902ed8c64f0 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "POST /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215/action" status: 202 len: 0 microversion: 2.1 time: 0.295999 Apr 09 02:02:34.570419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 450/892] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:02:34 2021] POST /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:02:34.580527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:34.581958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:34.592914 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.593418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.594361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:34.595011 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:34.841993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:34.869529 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-afac0076-29d7-4f90-b69f-99806a547860 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.293227 Apr 09 02:02:34.870224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 443/893] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:34 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:35.380317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:35.381827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:35.395924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:35.396473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:35.397333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:35.397834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:35.640525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:35.651181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:35.653759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:35.655334 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6626cfed-98ba-4036-828f-17b09d8db49c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.284571 Apr 09 02:02:35.656139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 451/894] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:35 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:35.891003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:35.891958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:35.900882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:35.901742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:35.903350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:35.904072 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:36.137336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:36.154374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-44e8adaa-c623-4baf-94a4-88ebbea6994b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.267810 Apr 09 02:02:36.155333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 444/895] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:35 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:36.675049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:36.675719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:36.685049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:36.685687 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:36.686598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:36.687165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:36.937732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:36.956473 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:36.958306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:36.959808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b25b2741-836d-4387-99ff-becc7c3e094a tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.288774 Apr 09 02:02:36.960580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 452/896] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:36 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:37.173988 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:37.174666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:37.183930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:37.184477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:37.185341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:37.185835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:37.403559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:37.424603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-da67f189-5920-4af3-a377-45ddfef4a47f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.254162 Apr 09 02:02:37.426221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 445/897] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:37 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:37.983418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:37.984291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:37.995205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:37.996254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:37.997132 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:37.997625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:38.230345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:38.241678 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:38.243376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:38.244707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d207f096-3691-4e77-bca0-8305c1af4acf tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.265890 Apr 09 02:02:38.245333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 453/898] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:37 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:38.448619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:38.449317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:38.457772 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:38.458270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:38.459134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:38.459621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:38.689071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:38.698394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f3fc2d03-c9fd-4710-9e48-5dae4e4ff6fc tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.254170 Apr 09 02:02:38.699139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 446/899] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:38 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:39.266294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:39.267262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:39.277188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:39.277694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:39.278564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:39.279077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:39.506220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:39.520514 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:39.524123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:39.526580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d49e088e-f35d-4c1a-b3ac-0827430c0528 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.264989 Apr 09 02:02:39.527782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 454/900] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:39 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:39.717317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:39.717992 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:39.726918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:39.727428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:39.728331 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:39.728959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:39.946728 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:39.958198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5d2a080-1147-47fc-b109-92cf2e1f3e35 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.244998 Apr 09 02:02:39.959224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 447/901] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:39 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:40.549899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:40.551160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:40.566920 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:40.567816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:40.569482 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:40.570339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:40.791209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:40.802148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:40.803852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:40.805173 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8fa8d608-f23b-4dc3-9a06-f44a0a7c200d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.261293 Apr 09 02:02:40.806249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 455/902] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:40 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:40.979297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:40.980616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:40.988995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:40.989496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:40.990340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:40.990826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:41.211215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:41.221063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-09b5b503-c220-4d84-8606-46e3c1e6c86b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.245885 Apr 09 02:02:41.221785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 448/903] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:40 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:41.826709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:41.827431 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:41.836125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:41.836533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:41.837378 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:41.837868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:42.052349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:42.063610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:42.065385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:42.066666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-977fbca4-62ae-4323-93e7-5fa538b88e9b tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.244285 Apr 09 02:02:42.067388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 456/904] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:41 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:42.244224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:42.245646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:42.266548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:42.267179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:42.268807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:42.269712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:42.584901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:42.601167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4b26de34-8a47-4e72-b5f5-9dad4fd7fa41 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.365453 Apr 09 02:02:42.602093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 449/905] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:42 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:43.086558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:43.087918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:43.096509 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:43.097384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:43.098442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:43.098945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:43.322697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:43.332835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:43.334532 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:43.335797 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5f7316f9-6167-4008-82b4-f2c47e06f5b4 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.253433 Apr 09 02:02:43.336468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 457/906] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:43 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:43.629942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:43.630518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:43.638709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:43.639205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:43.640063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:43.640552 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:43.851424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:43.862258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b6dd0159-8ee5-48b6-bd0c-ca15d9037c7b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.236268 Apr 09 02:02:43.867177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 450/907] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:43 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:44.355433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:44.356170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:44.365169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:44.365657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:44.366571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:44.367073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:44.621077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:44.631774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:44.633579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:44.635039 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b1093aa8-1f6a-442e-808e-d089b7be299c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.283644 Apr 09 02:02:44.635685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 458/908] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:44 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:44.882299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:44.882973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:44.922714 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:44.923471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:44.924567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:44.925239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:45.349868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:45.361156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5735b0eb-9f74-4cf5-ba21-43088bef7c87 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.482367 Apr 09 02:02:45.362273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 451/909] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:44 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:45.656966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:45.657553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:45.666155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:45.666633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:45.668075 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:45.668538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:46.135461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:46.145612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:46.147286 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:46.148584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6e1d14b8-8032-44c5-b29f-46e1c21981e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.495918 Apr 09 02:02:46.149269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 459/910] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:45 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:46.380610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:46.381282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:46.390007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:46.390510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:46.391363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:46.391851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:46.592877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:46.602094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-16b97239-514a-4ec1-9b0d-447b7dd82c36 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.225580 Apr 09 02:02:46.602742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 452/911] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:46 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:47.030785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-95d1cc68-58fc-4a7c-8004-e7bc23e0090c req-14a2d05b-df37-42bb-924b-1c13f27ce760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "name": "network-vif-plugged", "status": "completed", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:47.041301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:02:47.041301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:02:47.049475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-95d1cc68-58fc-4a7c-8004-e7bc23e0090c req-14a2d05b-df37-42bb-924b-1c13f27ce760 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:47.050313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-95d1cc68-58fc-4a7c-8004-e7bc23e0090c req-14a2d05b-df37-42bb-924b-1c13f27ce760 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:47.085038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-95d1cc68-58fc-4a7c-8004-e7bc23e0090c req-14a2d05b-df37-42bb-924b-1c13f27ce760 service nova] Creating event network-vif-plugged:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:02:47.094516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-95d1cc68-58fc-4a7c-8004-e7bc23e0090c req-14a2d05b-df37-42bb-924b-1c13f27ce760 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067747 Apr 09 02:02:47.095671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 460/912] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:02:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:02:47.171176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:47.172028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:47.180310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:47.180911 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:47.181838 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:47.182430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:47.445472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:47.455262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:47.457012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:47.458441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b8885222-4693-4e27-85c0-e7134c4106ee tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.293723 Apr 09 02:02:47.467712 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 453/913] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:47 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:47.621859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:47.622700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:47.631026 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:47.631474 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:47.632340 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:47.632837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:47.835145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:47.844801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2b0d44b-d169-4c5f-8df0-a19c1d3942ff tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.227499 Apr 09 02:02:47.845441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 461/914] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:47 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:48.478694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:48.479372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:48.488078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:48.488591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:48.489463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:48.489954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:48.698091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:48.708429 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:48.710272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:48.711533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-45fad405-5f6a-422c-912f-be1f335ddcb1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1727 microversion: 2.20 time: 0.237613 Apr 09 02:02:48.712219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 454/915] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:48 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1727 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:48.863330 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:48.864309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:48.872933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:48.873523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:48.874818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:48.875385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:49.101975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:49.112737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b7b645c5-c3f2-4c02-acf1-959d7cccecc8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.253701 Apr 09 02:02:49.113852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 462/916] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:48 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:49.731293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:49.732005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:49.741176 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:49.741686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:49.742561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:49.743053 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:49.960694 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:49.970756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:49.972483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:49.973751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-31603313-57ee-4630-9980-b9c13f553de1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1714 microversion: 2.20 time: 0.246680 Apr 09 02:02:49.974379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 455/917] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:02:49 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1714 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:02:50.133441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:50.134035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:50.142590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:50.143106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:50.143969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:50.144498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:50.349996 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:50.359807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0e0622e6-46b8-4f1f-8bbc-f2ceae856f7c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.230455 Apr 09 02:02:50.360517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 463/918] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:50 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:51.384420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:51.385223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:51.394067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:51.394574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:51.395459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:51.395949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:51.607463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:51.617205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7de2be89-4ac6-4896-8d9d-85000ba8d92b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.239685 Apr 09 02:02:51.617865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 456/919] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:51 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:52.636415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:52.637237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:52.645902 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:52.646443 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:52.647293 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:52.647793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:52.871243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:52.889814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d50d457b-cc70-4327-b39b-e5a5ed95592c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.257423 Apr 09 02:02:52.890932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 464/920] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:52 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:53.913397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:53.914469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:53.924190 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:53.924700 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:53.925573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:53.926071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:54.142684 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:54.160564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-57d63d2c-5efe-4b88-96da-7dc94d0ee12f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.253115 Apr 09 02:02:54.161659 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 457/921] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:53 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:55.192782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:55.194073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:55.208636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:55.209468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:55.210982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:55.211872 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:55.430136 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:55.440520 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ab95df04-5591-4150-9c8b-3dcf739f806e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.255411 Apr 09 02:02:55.441212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 465/922] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:55 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:56.459793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:56.460492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:56.469101 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:56.469609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:56.470463 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:56.470957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:56.707344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:56.718985 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-795e9471-0da5-47fe-9747-c6a550508717 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.263168 Apr 09 02:02:56.720058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 458/923] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:56 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:57.745585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:57.746462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:57.754885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:57.755398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:57.756297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:57.756802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:58.064815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:58.075715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-508def8f-bad5-4bf4-b716-3d518638c06b tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.334270 Apr 09 02:02:58.076386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 466/924] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:57 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:59.095693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:59.096309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:59.104572 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.105109 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.105982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.106494 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.311227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:59.321343 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0175a6b6-186c-4b9d-a109-0e872beeb551 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1506 microversion: 2.1 time: 0.229926 Apr 09 02:02:59.322004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 459/925] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:59 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:59.344869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:02:59.345973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:59.357503 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.358007 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.358856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.359341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.578978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3acd84f8-86d6-4534-8a61-ef29b9f3f08f tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "POST /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215/action" status: 202 len: 0 microversion: 2.1 time: 0.242469 Apr 09 02:02:59.579869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 467/926] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:02:59 2021] POST /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:02:59.588335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:59.589009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:59.597375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.597959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.598840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.599329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.632862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:59.633828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:59.644948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.645565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.646567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.647211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.721538 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:02:59.856315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:02:59.858062 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e166b0bb-b6f0-4cbc-bec1-a6b3f039dfe9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 204 len: 0 microversion: 2.1 time: 0.231402 Apr 09 02:02:59.859535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 468/927] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:02:59 2021] DELETE /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:02:59.869464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-46f298e6-b022-43e9-871b-b91f4493fe64 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1514 microversion: 2.1 time: 0.285150 Apr 09 02:02:59.870436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 460/928] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:59 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:02:59.885034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:02:59.886802 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:02:59.894952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.895457 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:02:59.896484 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:02:59.896972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:00.152342 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:00.163230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-398b72ad-575b-4bfd-8659-32fea52e2b5e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1576 microversion: 2.1 time: 0.285792 Apr 09 02:03:00.163881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 469/929] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:02:59 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:00.902462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:00.903220 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:00.911815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:00.912477 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:00.913425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:00.913919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:01.115092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:01.125083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-12bf8cfb-3cde-4f4e-9aab-5410bcb4ca70 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1514 microversion: 2.1 time: 0.228098 Apr 09 02:03:01.125756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 461/930] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:00 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:01.182942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:01.183589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:01.193183 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:01.193691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:01.194567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:01.195063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:01.403354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:01.416458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-71415c94-2a8e-403c-b47c-53fa6126e953 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1576 microversion: 2.1 time: 0.238063 Apr 09 02:03:01.417475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 470/931] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:01 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:02.144897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:02.145571 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:02.153757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:02.154251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:02.155091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:02.155582 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:02.295106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-0cbc7c6d-dadc-4377-a3cb-f0593c812d63 req-ca9b2376-cf86-489d-aea3-3ee95a5085ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "name": "network-vif-unplugged", "status": "completed", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:02.297462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:02.297462 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:02.318181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-0cbc7c6d-dadc-4377-a3cb-f0593c812d63 req-ca9b2376-cf86-489d-aea3-3ee95a5085ac service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:02.318731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-0cbc7c6d-dadc-4377-a3cb-f0593c812d63 req-ca9b2376-cf86-489d-aea3-3ee95a5085ac service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:02.349050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.compute.server_external_events [req-0cbc7c6d-dadc-4377-a3cb-f0593c812d63 req-ca9b2376-cf86-489d-aea3-3ee95a5085ac service nova] Unable to find a host for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215. Dropping event network-vif-unplugged {{(pid=99349) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 09 02:03:02.350197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-0cbc7c6d-dadc-4377-a3cb-f0593c812d63 req-ca9b2376-cf86-489d-aea3-3ee95a5085ac service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061622 Apr 09 02:03:02.351278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 471/932] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:02 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 09 02:03:02.366528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:02.378472 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4f0cfd83-af7b-4fc6-9bf0-d2468db56fb2 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1514 microversion: 2.1 time: 0.237637 Apr 09 02:03:02.379321 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 462/933] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:02 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:02.443807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:02.444492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:02.452328 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:02.452844 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:02.453718 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:02.454208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:02.652750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:02.661871 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2c5677d7-48e1-43ce-989c-a473e18081cb tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1576 microversion: 2.1 time: 0.222039 Apr 09 02:03:02.662505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 472/934] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:02 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:03.397178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:03.397830 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:03.406442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:03.407134 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:03.408172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:03.408709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:03.680775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:03.681446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:03.690125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:03.690635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:03.691493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:03.691970 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:03.715814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:03.725112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8e5843a0-7512-4f39-94f3-2fe0cb3c26c1 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1516 microversion: 2.1 time: 0.332086 Apr 09 02:03:03.726019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 463/935] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:03 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:04.130452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:04.139372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b4d03485-d306-4b68-85f0-874c70029fa5 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1576 microversion: 2.1 time: 0.462634 Apr 09 02:03:04.140005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 473/936] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:03 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1576 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:04.746000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:04.746660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:04.754579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:04.755074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:04.755950 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:04.756460 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:05.157400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:05.158121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:05.166401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:05.168260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:05.169347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:05.169852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:05.570551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:05.580322 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-554edf91-eba4-46ff-a92b-1b6c037126e5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1516 microversion: 2.1 time: 0.838723 Apr 09 02:03:05.580990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 464/937] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:04 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1516 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:05.690022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:05.699648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6a8e8e4c-b908-4a4d-be92-0e1492b8679f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1576 microversion: 2.1 time: 0.546211 Apr 09 02:03:05.700339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 474/938] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:05 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1576 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:06.490387 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-8ad6e93d-2ee2-4166-b08f-662e94581658 req-220ed24a-a1cc-413c-9af9-26099097fd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd", "name": "network-vif-deleted", "tag": "6ccc6b33-8ac8-4278-a8df-c08a6caf6b01"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:06.493106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:06.493106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:06.503613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8ad6e93d-2ee2-4166-b08f-662e94581658 req-220ed24a-a1cc-413c-9af9-26099097fd4b service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:06.504086 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-8ad6e93d-2ee2-4166-b08f-662e94581658 req-220ed24a-a1cc-413c-9af9-26099097fd4b service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:06.524217 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-8ad6e93d-2ee2-4166-b08f-662e94581658 req-220ed24a-a1cc-413c-9af9-26099097fd4b service nova] Creating event network-vif-deleted:6ccc6b33-8ac8-4278-a8df-c08a6caf6b01 for instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd on hv-cinder-78462 Apr 09 02:03:06.530279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-8ad6e93d-2ee2-4166-b08f-662e94581658 req-220ed24a-a1cc-413c-9af9-26099097fd4b service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044140 Apr 09 02:03:06.530954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 465/939] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:06.598869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:06.599776 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:06.608489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:06.609298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:06.610253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:06.610751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:06.718135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:06.719360 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:06.727626 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:06.728283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:06.730478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:06.731139 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:06.818671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:06.830180 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-af48fffd-856f-4acc-a4e7-c9be5f7508c5 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.235328 Apr 09 02:03:06.830866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 475/940] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:06 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:06.887243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:06.907440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f93c9af0-03bd-4c75-ad94-2451139f6939 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 200 len: 1226 microversion: 2.1 time: 0.193899 Apr 09 02:03:06.908564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 466/941] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:06 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 1226 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:07.849138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:07.849816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:07.859032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:07.859545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:07.860435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:07.860934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:07.929262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:07.930441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:07.945554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:07.946368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:07.947739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:07.949181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:08.009065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] HTTP exception thrown: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. Apr 09 02:03:08.010049 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Returning 404 to user: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:08.011603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bc4d43cc-89a9-40be-8884-bd50c4e556d2 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 404 len: 111 microversion: 2.1 time: 0.089622 Apr 09 02:03:08.012218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 467/942] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:07 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 09 02:03:08.085738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:08.095857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d25c460b-090b-4703-8cbb-10473a12a96c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.250953 Apr 09 02:03:08.096742 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 476/943] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:07 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:08.139652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2058200927", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2115141322", "security_groups": [{"name": "tempest-secgroup-smoke-59632659"}], "block_device_mapping_v2": [{"uuid": "754d23a2-1a16-45ea-b898-e1a8de97a25e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1c93796-0098-4080-965f-a515624b9ca4"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:08.300907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] validate_networks() for [('e1c93796-0098-4080-965f-a515624b9ca4', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:03:08.889770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:03:08.890291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:03:08.890746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:03:08.891195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:03:08.891650 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:03:08.914647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:08.915144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:08.916035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:08.916530 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:08.941400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:03:08.945956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Getting quotas for user 03a5b233a6884b07ad75e45ff0d67453 and project 6bf79679be104ba7b95bf2c38a0760a5. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:03:09.075400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:03:09.078156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='754d23a2-1a16-45ea-b898-e1a8de97a25e',volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:03:09.114375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:09.115167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:09.123357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:09.124067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:09.124906 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:09.125556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:09.267662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1918c05c-8e4e-48f5-bdf7-a6f05ff0f0be tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.132033 Apr 09 02:03:09.268406 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 468/944] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:03:08 2021] POST /compute/v2.1/servers => generated 404 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:03:09.279696 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3fa342a8-86e8-4452-bfe8-4317c4479865 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:09.280401 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3fa342a8-86e8-4452-bfe8-4317c4479865 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:09.383414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-3fa342a8-86e8-4452-bfe8-4317c4479865 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:09.394058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3fa342a8-86e8-4452-bfe8-4317c4479865 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1095 microversion: 2.1 time: 0.118308 Apr 09 02:03:09.395043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 469/945] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:09 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1095 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:09.469815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:09.478874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1b76fe65-a653-4480-84c7-cb7d62dd3597 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.368941 Apr 09 02:03:09.480085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 477/946] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:09 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:10.417913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:10.420131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:10.434261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:10.435294 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:10.436181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:10.436839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:10.499197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:10.499891 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:10.513300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:10.513788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:10.520145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:10.520966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:10.907446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:10.937763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-75a184e0-1bdb-4c0d-b7df-3c9b7d9b3649 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1201 microversion: 2.1 time: 0.527349 Apr 09 02:03:10.939111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 470/947] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:10 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1201 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:11.082921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:11.092710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-29af3252-1b8e-44fd-8b99-44fd857aed2c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.598851 Apr 09 02:03:11.093432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 478/948] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:10 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:11.961348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:11.962495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:11.973677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:11.974329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:11.975270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:11.975848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:12.111792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:12.112504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:12.121174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:12.121691 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:12.122565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:12.123067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:12.518815 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:12.528807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ab84515f-cbfd-4333-a6aa-e373579d704f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.574514 Apr 09 02:03:12.529652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 471/949] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:11 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:12.571273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:12.581748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-771de802-e76b-4106-9552-03aa882f8444 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.474296 Apr 09 02:03:12.582434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 479/950] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:12 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:03:13.551605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:13.552780 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:13.564302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:13.564810 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:13.565666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:13.566151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:13.606376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:13.607481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:13.616539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:13.617247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:13.618296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:13.619143 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:13.971653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:13.986907 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7efa4587-3af8-490b-8a8d-b8b30d3867bd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.442543 Apr 09 02:03:13.988164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 472/951] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:13 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:13.992521 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:13.995762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-f109e1c6-1fd3-443c-bf5d-311a60198dcb req-79636e1b-5e40-4910-b6b3-51bdb402d234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4", "tag": "89d832cc-be13-4018-a9b8-17b29b05fe85"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:13.997655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:13.997655 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:14.006982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-88886078-977a-4d77-931a-b9859468cc0e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.409663 Apr 09 02:03:14.007865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 480/952] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:13 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:03:14.013426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f109e1c6-1fd3-443c-bf5d-311a60198dcb req-79636e1b-5e40-4910-b6b3-51bdb402d234 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:14.013927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f109e1c6-1fd3-443c-bf5d-311a60198dcb req-79636e1b-5e40-4910-b6b3-51bdb402d234 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:14.032948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-f109e1c6-1fd3-443c-bf5d-311a60198dcb req-79636e1b-5e40-4910-b6b3-51bdb402d234 service nova] Creating event network-changed:89d832cc-be13-4018-a9b8-17b29b05fe85 for instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 on hv-cinder-78462 Apr 09 02:03:14.038375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-f109e1c6-1fd3-443c-bf5d-311a60198dcb req-79636e1b-5e40-4910-b6b3-51bdb402d234 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048495 Apr 09 02:03:14.039052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 473/953] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:15.016932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:15.017583 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:15.026870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:15.027731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:15.028311 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:15.029697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:15.029893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:15.030744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:15.039641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:15.040465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:15.041417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:15.042206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:15.542554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:15.553715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9b717f9d-3ae1-44df-8342-f2d295bd54a6 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.530468 Apr 09 02:03:15.554557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 474/954] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:15 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:15.561164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:15.572238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-248e5695-13bb-4f82-b04c-cbbf58ad4cbe tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.562000 Apr 09 02:03:15.572915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 481/955] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:15 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:16.572574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:16.573365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:16.581446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:16.581949 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:16.582852 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:16.583350 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:16.590750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:16.591433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:16.599898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:16.600435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:16.601292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:16.601908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:16.891915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:16.897546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:16.901922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ac60dea6-8354-499e-b6f3-e67a1af0d164 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.333370 Apr 09 02:03:16.909201 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 475/956] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:16 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:16.916076 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c5ded851-3c88-4d51-95dc-e9ec96065c11 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.329266 Apr 09 02:03:16.917598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 482/957] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:16 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:17.190754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-f5f79988-d213-4da6-96b8-53d89ccc49db req-5e53eaa8-0889-4be9-ae3f-7762781d85e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "name": "network-vif-plugged", "status": "completed", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:17.192738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:17.192738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:17.202818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f5f79988-d213-4da6-96b8-53d89ccc49db req-5e53eaa8-0889-4be9-ae3f-7762781d85e0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:17.203317 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f5f79988-d213-4da6-96b8-53d89ccc49db req-5e53eaa8-0889-4be9-ae3f-7762781d85e0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:17.222672 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-f5f79988-d213-4da6-96b8-53d89ccc49db req-5e53eaa8-0889-4be9-ae3f-7762781d85e0 service nova] Creating event network-vif-plugged:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:03:17.228849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-f5f79988-d213-4da6-96b8-53d89ccc49db req-5e53eaa8-0889-4be9-ae3f-7762781d85e0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041975 Apr 09 02:03:17.229777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 476/958] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:17.390150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:03:17.390414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:03:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:03:17.922091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:17.922758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:17.931400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:17.931972 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:17.933423 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:17.933922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:17.940946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:17.941755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:17.957407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:17.958298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:17.959839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:17.960859 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:18.275566 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:18.284063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:18.285555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7b8087cc-4ad1-4be1-9ce1-71f87145ac97 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.353592 Apr 09 02:03:18.286212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 477/959] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:17 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:18.294133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9c57d828-24b6-4904-9fbc-f2d830a7d08e tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1572 microversion: 2.1 time: 0.376053 Apr 09 02:03:18.294790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 483/960] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:17 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1572 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:19.304840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:19.305510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:19.314381 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:19.314658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:19.314897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:19.315329 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:19.315746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:19.316385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:19.324453 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:19.325046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:19.325952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:19.326455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:19.611082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:19.619558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:19.624645 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a8795c08-18d3-4032-980d-2886cbcf18b0 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.324030 Apr 09 02:03:19.625307 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 478/961] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:19 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:19.629669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-caf2cd3c-7376-4b6a-91d8-2404df5c88d8 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1559 microversion: 2.1 time: 0.318973 Apr 09 02:03:19.630323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 484/962] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:19 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1559 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:03:20.643006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:20.643671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:20.651873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:20.652433 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:20.653288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:20.653779 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:20.854314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:20.863434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-10ebf83d-e31d-417a-8137-f06884c1139f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.224703 Apr 09 02:03:20.864059 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 479/963] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:20 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:21.882015 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:21.882709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:21.891974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:21.892506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:21.893391 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:21.893886 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:22.095880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:22.105587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d1445fd5-23d1-4470-a462-9e1bef6d451b tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.227358 Apr 09 02:03:22.106195 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 485/964] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:21 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:23.123471 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:23.124187 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:23.132335 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:23.132848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:23.133702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:23.134193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:23.341863 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:23.351181 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d835d556-537b-4206-a630-76356276c9ba tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.231933 Apr 09 02:03:23.351978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 480/965] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:23 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:24.369825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:24.370483 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:24.378372 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:24.378876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:24.379717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:24.380234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:24.570708 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:24.580230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c2f27683-d403-42fb-8d42-6b4b2843bca1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.214504 Apr 09 02:03:24.580862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 486/966] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:24 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:25.230826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3aae2e86-9bc9-42c5-a853-98264f535408 req-b06e6b69-68da-4f24-9ec7-1d0ba4479746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4", "name": "network-vif-plugged", "status": "completed", "tag": "89d832cc-be13-4018-a9b8-17b29b05fe85"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:25.233373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:25.233373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:25.243923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3aae2e86-9bc9-42c5-a853-98264f535408 req-b06e6b69-68da-4f24-9ec7-1d0ba4479746 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:25.244438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3aae2e86-9bc9-42c5-a853-98264f535408 req-b06e6b69-68da-4f24-9ec7-1d0ba4479746 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:25.263145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3aae2e86-9bc9-42c5-a853-98264f535408 req-b06e6b69-68da-4f24-9ec7-1d0ba4479746 service nova] Creating event network-vif-plugged:89d832cc-be13-4018-a9b8-17b29b05fe85 for instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 on hv-cinder-78462 Apr 09 02:03:25.268455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3aae2e86-9bc9-42c5-a853-98264f535408 req-b06e6b69-68da-4f24-9ec7-1d0ba4479746 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041621 Apr 09 02:03:25.269125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 481/967] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:25.598179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:25.598917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:25.607592 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:25.608253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:25.609104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:25.609595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:25.804276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:25.813006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-62671ecf-b7b6-40fd-9dd1-b76c0bbb2a63 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.219133 Apr 09 02:03:25.813634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 487/968] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:25 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:26.831649 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:26.832446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:26.841597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:26.842113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:26.842967 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:26.843459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:27.056792 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:27.069280 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e6ed9010-b899-4194-8433-ee168646719e tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1265 microversion: 2.1 time: 0.242061 Apr 09 02:03:27.069940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 482/969] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:26 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:28.087210 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:28.087876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:28.096125 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:28.096720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:28.097574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:28.098069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:28.304142 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:28.313683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6f4354b9-a7fa-4919-9faf-b8725e3ccbd1 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1451 microversion: 2.1 time: 0.230557 Apr 09 02:03:28.314454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 488/970] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:28 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:03:28.330698 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:28.331371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:28.339262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:28.339774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:28.340642 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:28.341133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:28.539508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:28.548954 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0e90ce7c-2f99-4adc-bc3d-9165920e7c4d tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1451 microversion: 2.1 time: 0.222299 Apr 09 02:03:28.549579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 483/971] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:28 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:03:30.416379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:30.416961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:30.426621 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:30.427226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:30.428214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:30.428775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:30.507605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:03:30.640747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e9d604dd-a70b-41cd-9eb8-6d2e8b783505 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 204 len: 0 microversion: 2.20 time: 0.228913 Apr 09 02:03:30.645788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 489/972] 10.222.0.38 () {60 vars in 1270 bytes} [Fri Apr 9 02:03:30 2021] DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 09 02:03:30.651278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:30.651951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:30.660510 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:30.661014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:30.661850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:30.662341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:30.906089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:30.917118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:30.918893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:30.920268 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-52863feb-f1d1-470f-a474-56e1c43a1cc1 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.273065 Apr 09 02:03:30.921193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 484/973] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:30 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:31.601812 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-5949d328-3648-4fde-a808-291ecf5917c6 req-0a7749d7-816a-4da6-a868-a4dcd0fc9072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4", "tag": "89d832cc-be13-4018-a9b8-17b29b05fe85"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:31.603458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:31.603458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:31.613272 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5949d328-3648-4fde-a808-291ecf5917c6 req-0a7749d7-816a-4da6-a868-a4dcd0fc9072 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:31.613774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5949d328-3648-4fde-a808-291ecf5917c6 req-0a7749d7-816a-4da6-a868-a4dcd0fc9072 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:31.631046 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-5949d328-3648-4fde-a808-291ecf5917c6 req-0a7749d7-816a-4da6-a868-a4dcd0fc9072 service nova] Creating event network-changed:89d832cc-be13-4018-a9b8-17b29b05fe85 for instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 on hv-cinder-78462 Apr 09 02:03:31.636230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-5949d328-3648-4fde-a808-291ecf5917c6 req-0a7749d7-816a-4da6-a868-a4dcd0fc9072 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038838 Apr 09 02:03:31.637061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 490/974] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:31.940602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:31.941239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:31.949298 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:31.950301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:31.951133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:31.951616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:32.149933 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:32.160448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:32.162119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:32.163346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-e65a9189-dfe3-463e-94f7-f9fb6a0475ad tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.226976 Apr 09 02:03:32.163963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 485/975] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:31 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:33.184205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:33.184893 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:33.193138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:33.193647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:33.195418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:33.195922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:33.395910 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:33.405917 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:33.407616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:33.408903 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d4b43e31-c75a-489d-a02e-7bd718dc181c tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.229552 Apr 09 02:03:33.410376 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 491/976] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:33 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:34.429274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:34.430071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:34.439108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:34.439618 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:34.440493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:34.440986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:34.725573 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:34.735579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:34.737543 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:34.738755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-eb4f01f7-42ce-4719-af55-e5164330562d tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.313794 Apr 09 02:03:34.739370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 486/977] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:34 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:35.758868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:35.760541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:35.769245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:35.769843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:35.770777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:35.771410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:36.277426 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:36.287450 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:36.289209 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:36.290435 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2d6f35a1-6a36-44d5-9594-5ddba36b1d37 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1720 microversion: 2.20 time: 0.536083 Apr 09 02:03:36.291061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 492/978] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:35 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1720 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:37.027048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-d3314c28-3942-46c9-b27a-1d543e62e833 req-ac824e80-47e8-49ee-ab43-d4438c45b389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7e7822-32d3-49f3-9878-3d61727a65ee", "name": "network-vif-deleted", "tag": "6dd2d631-1997-4a1f-bbbc-8809cba98527"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:03:37.037409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:03:37.037409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:03:37.049048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d3314c28-3942-46c9-b27a-1d543e62e833 req-ac824e80-47e8-49ee-ab43-d4438c45b389 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:37.049908 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-d3314c28-3942-46c9-b27a-1d543e62e833 req-ac824e80-47e8-49ee-ab43-d4438c45b389 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:37.081145 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-d3314c28-3942-46c9-b27a-1d543e62e833 req-ac824e80-47e8-49ee-ab43-d4438c45b389 service nova] Creating event network-vif-deleted:6dd2d631-1997-4a1f-bbbc-8809cba98527 for instance 9c7e7822-32d3-49f3-9878-3d61727a65ee on hv-cinder-78462 Apr 09 02:03:37.089034 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-d3314c28-3942-46c9-b27a-1d543e62e833 req-ac824e80-47e8-49ee-ab43-d4438c45b389 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071698 Apr 09 02:03:37.092948 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 487/979] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:03:37.311533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:37.312231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:37.320588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:37.321284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:37.322200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:37.322701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:37.399697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:37.400277 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:37.400786 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lazy-loading 'fault' on Instance uuid 9c7e7822-32d3-49f3-9878-3d61727a65ee {{(pid=99349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:03:37.483585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:37.494454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:37.498553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '051f419a8be54277a9ded252bd114bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf455ad3606b44cea681dcfebb803125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:03:37.499964 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-21e22ef5-8056-4795-92d0-09c910fb78e8 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 200 len: 1369 microversion: 2.20 time: 0.193202 Apr 09 02:03:37.500741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 493/980] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:37 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 09 02:03:38.520790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:38.521560 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:38.530048 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:38.530600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:38.531735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:38.532250 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:38.588479 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. Apr 09 02:03:38.589467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:38.590418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-02184c5e-8d12-4c6c-8946-4dd39556aea6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 404 len: 111 microversion: 2.20 time: 0.074529 Apr 09 02:03:38.591037 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 488/981] 10.222.0.38 () {60 vars in 1267 bytes} [Fri Apr 9 02:03:38 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 09 02:03:38.600352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-560a9923-aac4-4696-8a35-bf3535f3b4a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '.version_select at 0x7f966ca510d0>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:38.620658 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-560a9923-aac4-4696-8a35-bf3535f3b4a5 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497645962" status: 204 len: 0 microversion: 2.20 time: 0.024541 Apr 09 02:03:38.621368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 494/982] 10.222.0.38 () {60 vars in 1249 bytes} [Fri Apr 9 02:03:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497645962 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 09 02:03:41.047155 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:41.047706 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:41.055489 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:41.056019 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:41.056848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:41.057341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:41.119246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. Apr 09 02:03:41.120068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:41.120974 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b79b6cd0-e4f4-41ba-88d2-58db4eb877fe tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 404 len: 111 microversion: 2.1 time: 0.078036 Apr 09 02:03:41.121615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 489/983] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:03:41 2021] DELETE /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:03:41.130270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:41.130939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 9c7e7822-32d3-49f3-9878-3d61727a65ee] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:41.139312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:41.139821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:41.140697 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:41.141198 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:41.197733 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. Apr 09 02:03:41.198410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 9c7e7822-32d3-49f3-9878-3d61727a65ee could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:41.199326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a8560b1c-d81b-4de4-979d-0acea2f3ab6e tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee" status: 404 len: 111 microversion: 2.1 time: 0.073149 Apr 09 02:03:41.199945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 495/984] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:41 2021] GET /compute/v2.1/servers/9c7e7822-32d3-49f3-9878-3d61727a65ee => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:03:42.450273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:42.451541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:42.459750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:42.460366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:42.461315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:42.461995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:42.517099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. Apr 09 02:03:42.517921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:42.518644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-312089b8-120a-4d9a-9c4a-aa92768971a3 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 404 len: 111 microversion: 2.1 time: 0.072651 Apr 09 02:03:42.519267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 490/985] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:03:42 2021] DELETE /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:03:42.527946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:03:42.529305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] [instance: 3c14a62f-95a1-44dd-8d6a-b490bcf95c48] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:03:42.537111 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:42.537633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:42.538476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:03:42.538973 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:03:42.592930 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] HTTP exception thrown: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. Apr 09 02:03:42.593723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] Returning 404 to user: Instance 3c14a62f-95a1-44dd-8d6a-b490bcf95c48 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:03:42.594518 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-44b1408f-da32-4539-8832-ff456abcacb6 tempest-AttachVolumeShelveTestJSON-2049779385 tempest-AttachVolumeShelveTestJSON-2049779385-project] 10.222.0.38 "GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48" status: 404 len: 111 microversion: 2.1 time: 0.070786 Apr 09 02:03:42.595147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 496/986] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:03:42 2021] GET /compute/v2.1/servers/3c14a62f-95a1-44dd-8d6a-b490bcf95c48 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:04:11.088535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'create', calling method: .version_select at 0x7f966d45e730>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1047535156"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:11.118711 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:04:11.123245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for user 09378cddefd5450f82183f917fd891d0 and project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:04:11.298119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:04:11.302526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for user 09378cddefd5450f82183f917fd891d0 and project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'key_pairs'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:04:11.318168 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-adcccbbc-d1d7-499c-aa0a-d4d597f51d7e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.233778 Apr 09 02:04:11.318819 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 491/987] 10.222.0.38 () {60 vars in 1148 bytes} [Fri Apr 9 02:04:11 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:11.501646 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1196224121", "imageRef": "27e196dc-a9cd-47f3-aaf2-c5aaa00c6a5b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1047535156", "networks": [{"uuid": "f935c478-f94d-4bd4-a6d7-7737058c87a8"}]}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:11.581251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] validate_networks() for [('f935c478-f94d-4bd4-a6d7-7737058c87a8', None, None, None)] {{(pid=99349) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:04:12.460305 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Flavor limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:04:12.461881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Image limits 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:04:12.461881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Flavor pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:04:12.461881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Image pref 0:0:0 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:04:12.462818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:04:12.479096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:12.479783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:12.480755 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:12.481744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:12.501260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:04:12.505685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Getting quotas for user 09378cddefd5450f82183f917fd891d0 and project 2904e607b69d4a30b9f267f4947ec8f3. Resources: {'cores', 'ram', 'instances'} {{(pid=99349) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:04:12.521475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Going to run 1 instances... {{(pid=99349) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:04:12.524149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27e196dc-a9cd-47f3-aaf2-c5aaa00c6a5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:04:12.590036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d2c561ca-6bb4-4a04-9810-b4ebc8071306 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093034 Apr 09 02:04:12.596071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 497/988] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:04:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:04:12.606686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-dfee89b3-f448-434d-b9b4-baa4927ef5f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:12.608504 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-dfee89b3-f448-434d-b9b4-baa4927ef5f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:12.711338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-dfee89b3-f448-434d-b9b4-baa4927ef5f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:12.723246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-dfee89b3-f448-434d-b9b4-baa4927ef5f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1259 microversion: 2.1 time: 0.124433 Apr 09 02:04:12.724006 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 492/989] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:12 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1259 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:13.743561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:13.744371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:13.753447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:13.754222 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:13.755177 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:13.755753 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:13.963534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:13.980783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-78f7258f-cb14-48f1-bcd8-810a760ba2e0 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1319 microversion: 2.1 time: 0.241908 Apr 09 02:04:13.982828 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 498/990] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:13 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:15.003784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:15.006619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:15.027219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:15.027969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:15.031017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:15.032150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:15.543961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:15.557421 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8180ae08-899a-4e9d-a965-052c15a30fe5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.558600 Apr 09 02:04:15.558312 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 493/991] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:14 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:16.577465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:16.578082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:16.586419 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:16.587017 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:16.587951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:16.588638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:16.843682 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:16.853522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-946bc2fb-09fa-4ead-a838-6fa30d4c6c54 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.280205 Apr 09 02:04:16.854029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 499/992] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:16 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:17.874807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:17.875491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:17.887609 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:17.888438 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:17.889470 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:17.890228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:18.224326 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:18.234751 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5ef7d8e-07d5-4bc7-9486-08f4997523df tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.365696 Apr 09 02:04:18.241437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 494/993] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:17 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:19.254044 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:19.254727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:19.263077 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:19.263834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:19.265133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:19.265983 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:19.620184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:19.636416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ea3461b8-6249-43b6-946e-26a34b51caf8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.386206 Apr 09 02:04:19.637454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 500/994] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:19 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:20.655344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:20.656939 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:20.665747 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:20.666782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:20.667848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:20.669104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:20.995402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:21.006934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1a14bfb0-b84d-4b35-b8bb-57ffd790f537 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.355834 Apr 09 02:04:21.011496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 495/995] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:20 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:22.027437 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:22.028104 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:22.036850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:22.037664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:22.038715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:22.039395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:22.243613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:22.253782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-13bc3bd4-6c09-406b-8b8b-6817868bf878 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.230541 Apr 09 02:04:22.254442 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 501/996] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:22 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:23.272357 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:23.273002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:23.282089 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:23.282602 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:23.283481 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:23.284016 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:23.500363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:23.509849 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a784eedf-ea81-46fc-96ef-5a916a5066bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.241485 Apr 09 02:04:23.510606 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 496/997] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:23 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:04:24.529234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:24.529897 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:24.537719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:24.538218 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:24.539047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:24.539533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:24.904150 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:24.914323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d142e6bb-df4d-4361-a4e8-3672c20bbb93 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.389710 Apr 09 02:04:24.924548 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 502/998] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:24 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:25.931840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:25.932773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:25.941212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:25.942363 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:25.943300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:25.947576 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:26.136078 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3785218a-6332-489e-9ffd-997bc20ef1f1 req-84a5e98f-8ecb-4c29-bb10-d1b1e4510938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:26.138455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:26.138455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:26.148612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3785218a-6332-489e-9ffd-997bc20ef1f1 req-84a5e98f-8ecb-4c29-bb10-d1b1e4510938 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:26.149447 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3785218a-6332-489e-9ffd-997bc20ef1f1 req-84a5e98f-8ecb-4c29-bb10-d1b1e4510938 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:26.169978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3785218a-6332-489e-9ffd-997bc20ef1f1 req-84a5e98f-8ecb-4c29-bb10-d1b1e4510938 service nova] Creating event network-changed:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:04:26.176065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3785218a-6332-489e-9ffd-997bc20ef1f1 req-84a5e98f-8ecb-4c29-bb10-d1b1e4510938 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044170 Apr 09 02:04:26.177068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 503/999] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:26.251022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:26.263882 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0597ae63-e1f6-43a8-bfbe-1fe98191538d tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.336020 Apr 09 02:04:26.264702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 497/1000] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:25 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:27.283362 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:27.284179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:27.292247 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:27.292738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:27.294459 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:27.295014 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:27.848952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:27.858757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-29f80c9f-ff74-4f46-99c2-1d5aa1b56bff tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.579894 Apr 09 02:04:27.859394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 504/1001] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:27 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:28.878320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:28.878960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:28.887205 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:28.888103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:28.889178 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:28.889863 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:29.204860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:29.214402 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-12427fd0-a00a-4fe4-ab6a-cc9a04ee1c79 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.340005 Apr 09 02:04:29.215009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 498/1002] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:28 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:30.234060 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:30.234735 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:30.242835 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:30.243345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:30.244216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:30.244717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:30.449533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:30.460058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a3fe5f92-9f77-4b92-b039-a7c738c00785 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.230583 Apr 09 02:04:30.460774 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 505/1003] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:30 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:31.478430 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:31.479744 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:31.489292 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:31.489801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:31.490653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:31.491148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:31.594551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-902338ad-3e6c-47d4-8fae-4391a444cb71 req-2684de30-49e8-4b5f-864a-b1a7c9859bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "name": "network-vif-plugged", "status": "completed", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:31.596993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:31.596993 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:31.607805 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-902338ad-3e6c-47d4-8fae-4391a444cb71 req-2684de30-49e8-4b5f-864a-b1a7c9859bf7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:31.608461 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-902338ad-3e6c-47d4-8fae-4391a444cb71 req-2684de30-49e8-4b5f-864a-b1a7c9859bf7 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:31.652302 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-902338ad-3e6c-47d4-8fae-4391a444cb71 req-2684de30-49e8-4b5f-864a-b1a7c9859bf7 service nova] Creating event network-vif-plugged:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:04:31.660084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-902338ad-3e6c-47d4-8fae-4391a444cb71 req-2684de30-49e8-4b5f-864a-b1a7c9859bf7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072068 Apr 09 02:04:31.660796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 506/1004] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:31.700480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:31.710811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-70e78444-cfc4-4ea5-af89-54f2860d86c6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.236411 Apr 09 02:04:31.711448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 499/1005] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:31 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:32.729868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:32.730635 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:32.739534 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:32.740074 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:32.740915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:32.741409 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:32.958068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:32.967114 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-440877a9-6fb8-41a8-a07b-d2d1a7f66879 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1359 microversion: 2.1 time: 0.241726 Apr 09 02:04:32.967767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 507/1006] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:32 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:33.987099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:33.987765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:33.996932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:33.997439 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:33.998275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:33.998765 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.193806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:34.202616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9df81aab-33b4-4bb6-8c35-a41cb9b0fa8e tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1550 microversion: 2.1 time: 0.220742 Apr 09 02:04:34.203238 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 500/1007] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:33 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1550 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:04:34.220184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:34.220855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:34.228734 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.229243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.230080 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.230574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.425364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:34.434775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a4986486-8428-4922-bdca-15623f030e03 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1550 microversion: 2.1 time: 0.218227 Apr 09 02:04:34.435404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 508/1008] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:34 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:34.451722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:34.455397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:34.455397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:34.456533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:34.457345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Searching by: {'deleted': False, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3'} {{(pid=99348) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 09 02:04:34.463324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.463830 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.464790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.465320 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.568498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.multi_cell_list [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=99348) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 09 02:04:34.667869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b5a5c1fd-54cc-499c-a306-53450642c4d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220073 Apr 09 02:04:34.669154 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 501/1009] 10.222.0.38 () {58 vars in 1115 bytes} [Fri Apr 9 02:04:34 2021] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:34.680533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:34.681313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:34.690521 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.690827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.691709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:34.692377 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:34.977416 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:34.987593 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-96804c25-ec38-45e1-940f-47424a057ea1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1550 microversion: 2.1 time: 0.310779 Apr 09 02:04:34.994128 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 509/1010] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:34 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1550 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:36.826213 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d019e2b6-3cd6-4a47-b3d0-631eaae5a04d"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:36.827386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:36.835256 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:36.835754 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:36.836611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:36.837094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:37.220637 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-774abf6a-0c81-43e2-8b95-fb8ff15547d5 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398872 Apr 09 02:04:37.221314 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 502/1011] 10.222.0.38 () {60 vars in 1313 bytes} [Fri Apr 9 02:04:36 2021] POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:45.287822 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:45.288524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:45.297458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:45.297969 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:45.298820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:45.299318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:45.503441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:45.513885 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5ebb1bb0-6389-4d57-b332-6aad159e7dbd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1596 microversion: 2.1 time: 0.230662 Apr 09 02:04:45.514525 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 510/1012] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:45 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1596 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:45.953124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-148369241", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "f7ba46a5-7263-4935-8c1f-672d543c4652"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:46.027945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] validate_networks() for [('f7ba46a5-7263-4935-8c1f-672d543c4652', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:04:46.964445 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:04:46.965605 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:04:46.966394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:04:46.966857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:04:46.967304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:04:46.976540 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:46.977035 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:46.977900 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:46.978388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:47.001289 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Getting quotas for project b6edc047e08f402280f417ae3e5d83df. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:04:47.005703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Getting quotas for user d451f2ec72504ef280582ee03a8c45c9 and project b6edc047e08f402280f417ae3e5d83df. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:04:47.015251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:04:47.018083 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:04:47.069799 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8e644d73-fcca-44e7-aea9-03e024ff669d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122296 Apr 09 02:04:47.070701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 503/1013] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:04:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:04:47.081749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b9a1b9a2-dbc1-40de-a671-071573f75902 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:47.082395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b9a1b9a2-dbc1-40de-a671-071573f75902 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:47.178952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b9a1b9a2-dbc1-40de-a671-071573f75902 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:47.187422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b9a1b9a2-dbc1-40de-a671-071573f75902 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1213 microversion: 2.1 time: 0.109595 Apr 09 02:04:47.188091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 511/1014] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:47 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:48.206806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:48.207636 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:48.222778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:48.223332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:48.231962 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:48.232527 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:48.442113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:48.451731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cb9a2e30-d0ca-4382-b56a-f094914cf03e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1273 microversion: 2.1 time: 0.249591 Apr 09 02:04:48.452856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 504/1015] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:48 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:49.471434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:49.472267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:49.481549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:49.482156 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:49.483106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:49.483681 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:49.765966 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:49.775225 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fe5541c4-9aae-4964-8eeb-1ed911142e74 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1271 microversion: 2.1 time: 0.308239 Apr 09 02:04:49.775869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 512/1016] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:49 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:50.085164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-195b25fe-6fd0-4484-ab0d-75546637b792 req-94ede487-f675-4f39-be63-b6b2101f27f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:50.087686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:50.087686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:50.098556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-195b25fe-6fd0-4484-ab0d-75546637b792 req-94ede487-f675-4f39-be63-b6b2101f27f1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:50.099270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-195b25fe-6fd0-4484-ab0d-75546637b792 req-94ede487-f675-4f39-be63-b6b2101f27f1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:50.119478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-195b25fe-6fd0-4484-ab0d-75546637b792 req-94ede487-f675-4f39-be63-b6b2101f27f1 service nova] Creating event network-changed:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:04:50.126102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-195b25fe-6fd0-4484-ab0d-75546637b792 req-94ede487-f675-4f39-be63-b6b2101f27f1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051007 Apr 09 02:04:50.127359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 505/1017] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:50.796958 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:50.799476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:50.812978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:50.814131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:50.815688 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:50.817468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:51.386919 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-409691283"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:51.387544 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:51.396261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:51.396768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:51.397615 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:51.398107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:51.939740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:51.949208 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-fd840718-4131-44cc-b256-29b7e645c819 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 1.158427 Apr 09 02:04:51.955976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 513/1018] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:50 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:52.285703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.network.security_group_api [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Adding security group 327ddccf-da8d-46ff-aec2-c29141e16f99 to port 26f38c28-3730-4979-a46b-784e868af669 Apr 09 02:04:52.969295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:52.970040 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:52.978270 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:52.978782 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:52.979641 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:52.980310 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:53.993866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:54.003456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5d48bdb7-a2ad-4e08-9e26-4f93a5cd20ef tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 1.038985 Apr 09 02:04:54.004112 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 514/1019] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:52 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:04:55.020998 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:55.021565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:55.030131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:55.030634 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:55.031485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:55.031976 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:55.358353 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-14d5aa0d-92ab-4075-845d-6e39d61c331f tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action" status: 202 len: 0 microversion: 2.1 time: 3.976500 Apr 09 02:04:55.359689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 506/1020] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:04:51 2021] POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action => generated 0 bytes in 3979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:04:55.368995 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:55.369959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:55.379767 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:55.380288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:55.381371 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:55.381862 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:55.808539 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:55.818628 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-cb19ddaf-6693-4f2a-a8c7-436e488a3d11 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.801831 Apr 09 02:04:55.829158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 515/1021] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:55 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:04:55.835683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-abee3a97-62ab-4c34-85df-b6044af37b1a req-70165184-a901-4640-a0a9-5b0ecd70b1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:55.837455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:55.837455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:55.847346 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-abee3a97-62ab-4c34-85df-b6044af37b1a req-70165184-a901-4640-a0a9-5b0ecd70b1d0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:55.848131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-abee3a97-62ab-4c34-85df-b6044af37b1a req-70165184-a901-4640-a0a9-5b0ecd70b1d0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:55.871141 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-abee3a97-62ab-4c34-85df-b6044af37b1a req-70165184-a901-4640-a0a9-5b0ecd70b1d0 service nova] Creating event network-changed:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:04:55.878193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-abee3a97-62ab-4c34-85df-b6044af37b1a req-70165184-a901-4640-a0a9-5b0ecd70b1d0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046776 Apr 09 02:04:55.879223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 516/1022] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:04:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:56.063587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:56.078551 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4aa11228-927f-42f0-a0fb-4004f4ea49d6 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1760 microversion: 2.1 time: 0.713492 Apr 09 02:04:56.079397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 507/1023] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:55 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1760 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:04:56.214239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:56.215739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:56.223940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.224475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:56.225332 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.225834 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:56.293604 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:04:56.420951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f7480861-14e5-4638-81a2-e0d601559466 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "DELETE /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 204 len: 0 microversion: 2.1 time: 0.210782 Apr 09 02:04:56.425895 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 517/1024] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:04:56 2021] DELETE /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:04:56.431207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:56.435231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:56.444085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.444793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:56.445790 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.446341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:56.837957 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:56.838986 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:56.847922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.848749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:56.849775 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:56.850418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:57.187513 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:57.196934 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9dfa71e8-f658-48ad-9f62-6b65a3a4a205 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.769608 Apr 09 02:04:57.197756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 508/1025] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:56 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:57.722216 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:57.732288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4a0df869-7a18-4d0d-a15c-236b2ab81ea1 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.898368 Apr 09 02:04:57.733118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 518/1026] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:56 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:57.924018 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82bb62f6-1103-4cc9-90d9-d8555822cf37", "tag": "a98a9968-b6e7-44d8-8248-13c3906e4b22"}, {"name": "network-changed", "server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:04:57.925982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:04:57.925982 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:04:57.936127 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:57.936640 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:57.956456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] Creating event network-changed:a98a9968-b6e7-44d8-8248-13c3906e4b22 for instance 82bb62f6-1103-4cc9-90d9-d8555822cf37 on hv-cinder-78462 Apr 09 02:04:57.957032 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] Creating event network-changed:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:04:57.964232 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-23a92745-ba4c-4dfc-b4b3-067cf7b7dcc6 req-a0e262f5-2a68-4f43-ade7-1021b2d698c0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044501 Apr 09 02:04:57.965436 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 509/1027] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:04:57 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:04:58.217063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:58.217738 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:58.225832 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:58.226341 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:58.227185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:58.227677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:58.729869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:58.739308 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c3d96182-06fb-49b2-9466-4c01cd617572 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1565 microversion: 2.1 time: 0.526995 Apr 09 02:04:58.739961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 519/1028] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:58 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1565 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:58.752466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:58.753304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:58.762410 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:58.762915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:58.763771 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:58.764301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:59.293757 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:59.302745 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-76462609-f103-4cb4-bce3-5a4dc6cc8e7c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.555125 Apr 09 02:04:59.303379 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 510/1029] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:58 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:04:59.759796 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:04:59.760559 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:04:59.769100 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:59.769612 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:59.770452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:04:59.770938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:04:59.916448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:04:59.925497 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-277486c0-18f8-4dab-bbf7-1ebbb6b6784c tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1218 microversion: 2.1 time: 0.170547 Apr 09 02:04:59.926113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 520/1030] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:04:59 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:00.044036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-48d8f385-6fb0-45ef-904e-37370d17b98a req-4e762318-93af-4d73-8a3d-10afcfbbdb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215", "name": "network-vif-deleted", "tag": "73ca91c8-1321-4724-ba82-e895625c1079"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:00.045811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:00.045811 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:00.055261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-48d8f385-6fb0-45ef-904e-37370d17b98a req-4e762318-93af-4d73-8a3d-10afcfbbdb33 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:00.055762 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-48d8f385-6fb0-45ef-904e-37370d17b98a req-4e762318-93af-4d73-8a3d-10afcfbbdb33 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:00.075356 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-48d8f385-6fb0-45ef-904e-37370d17b98a req-4e762318-93af-4d73-8a3d-10afcfbbdb33 service nova] Creating event network-vif-deleted:73ca91c8-1321-4724-ba82-e895625c1079 for instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 on hv-cinder-78462 Apr 09 02:05:00.080564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-48d8f385-6fb0-45ef-904e-37370d17b98a req-4e762318-93af-4d73-8a3d-10afcfbbdb33 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 Apr 09 02:05:00.081246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 511/1031] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:05:00.323071 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:00.323743 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:00.332707 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:00.333214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:00.334073 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:00.334557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:00.535306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:00.544690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8943e31c-67b1-4438-aa97-30d6d1669a01 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.225903 Apr 09 02:05:00.545389 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 521/1032] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:00 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:00.944737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:00.945493 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:00.954610 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:00.955119 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:00.955959 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:00.956478 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:01.034702 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:01.035202 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:01.035704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lazy-loading 'fault' on Instance uuid 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:05:01.115349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacc7d9fd172477f9ae43e084f499884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b8f7fb01041abac3b9215f681e4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:01.124246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-34660186-7857-42c8-a14a-65593f0aaa50 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 200 len: 1223 microversion: 2.1 time: 0.184696 Apr 09 02:05:01.125094 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 512/1033] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:00 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:01.564784 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:01.565451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:01.573315 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:01.573816 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:01.575264 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:01.575758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:01.776485 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:01.785296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c3d0620e-fce0-4bcb-a7cb-86cb48dabf1e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.224525 Apr 09 02:05:01.785936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 522/1034] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:01 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:02.142851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:02.143516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] [instance: 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:02.151577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:02.152184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:02.153028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:02.153522 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:02.216674 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] HTTP exception thrown: Instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 could not be found. Apr 09 02:05:02.217349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Returning 404 to user: Instance 48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:05:02.218253 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-40f6b444-65b7-4cf4-aadc-7894356c274a tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215" status: 404 len: 111 microversion: 2.1 time: 0.079608 Apr 09 02:05:02.218877 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 513/1035] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:02 2021] GET /compute/v2.1/servers/48e3f8b5-ec6d-4db7-a8fe-b4c9fb588215 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:05:02.430666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-337dc8a9-871f-4396-ba89-f857fc409d13 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] Calling method '.version_select at 0x7f966c9c5f28>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:02.447306 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-337dc8a9-871f-4396-ba89-f857fc409d13 tempest-TestShelveInstance-1420462508 tempest-TestShelveInstance-1420462508-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-855700500" status: 202 len: 0 microversion: 2.1 time: 0.020706 Apr 09 02:05:02.447942 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 523/1036] 10.222.0.38 () {58 vars in 1241 bytes} [Fri Apr 9 02:05:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-855700500 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:05:02.804248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:02.804989 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:02.813082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:02.813591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:02.814446 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:02.814936 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:03.018866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:03.033952 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-abca7842-8a38-4238-bd9f-141f6db7d8a9 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.233786 Apr 09 02:05:03.034990 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 514/1037] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:02 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:03.879105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-f0e9a9a0-729a-40b2-be6e-e4882f35fd5e req-dfc9cf5d-3f7d-4784-bfe7-a069cdb17c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bb62f6-1103-4cc9-90d9-d8555822cf37", "name": "network-vif-plugged", "status": "completed", "tag": "a98a9968-b6e7-44d8-8248-13c3906e4b22"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:03.880940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:03.880940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:03.892506 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f0e9a9a0-729a-40b2-be6e-e4882f35fd5e req-dfc9cf5d-3f7d-4784-bfe7-a069cdb17c66 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:03.893031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-f0e9a9a0-729a-40b2-be6e-e4882f35fd5e req-dfc9cf5d-3f7d-4784-bfe7-a069cdb17c66 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:03.912574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-f0e9a9a0-729a-40b2-be6e-e4882f35fd5e req-dfc9cf5d-3f7d-4784-bfe7-a069cdb17c66 service nova] Creating event network-vif-plugged:a98a9968-b6e7-44d8-8248-13c3906e4b22 for instance 82bb62f6-1103-4cc9-90d9-d8555822cf37 on hv-cinder-78462 Apr 09 02:05:03.918629 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-f0e9a9a0-729a-40b2-be6e-e4882f35fd5e req-dfc9cf5d-3f7d-4784-bfe7-a069cdb17c66 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043499 Apr 09 02:05:03.920165 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 524/1038] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:05:04.052927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:04.053879 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:04.062144 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:04.062647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:04.063560 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:04.064064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:04.348313 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:04.357417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5fd7927b-d43e-484e-b70d-b8647744e51a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.308603 Apr 09 02:05:04.358052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 515/1039] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:04 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:05.375770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:05.376555 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:05.384600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:05.385096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:05.385924 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:05.386407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:05.662162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:05.671692 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-81fc1a5f-1a0c-4ec2-9693-3f74b6a5a64b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1313 microversion: 2.1 time: 0.300311 Apr 09 02:05:05.684012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 525/1040] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:05 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:06.692476 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:06.693773 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:06.702526 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:06.703030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:06.703896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:06.704427 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:06.912291 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:06.922103 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-8bfa123a-75a6-4257-9988-9743a974c46f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1497 microversion: 2.1 time: 0.233994 Apr 09 02:05:06.922726 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 516/1041] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:06 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:07.692382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:07.693000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:07.703516 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.704082 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:07.704918 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.705404 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:07.778813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:05:07.903894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7fb73780-7256-4681-a01e-ad530f5b7370 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "DELETE /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 204 len: 0 microversion: 2.1 time: 0.215952 Apr 09 02:05:07.904821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 526/1042] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:05:07 2021] DELETE /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:05:07.913597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:07.914382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:07.923303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.923814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:07.924737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.925227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:07.972212 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:07.973677 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:07.982814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.983550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:07.984587 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:07.985233 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:08.145881 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-7c7f1e3a-7053-42ff-8280-273f290a57bd tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action" status: 202 len: 0 microversion: 2.1 time: 0.178244 Apr 09 02:05:08.153003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 527/1043] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:05:07 2021] POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 09 02:05:08.165368 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:08.166279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:08.176496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:08.177009 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:08.177892 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:08.178393 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:08.820710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:08.830275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-edbde871-4dba-4937-b906-fb8e186111c5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1503 microversion: 2.1 time: 0.920787 Apr 09 02:05:08.830912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 517/1044] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:07 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1503 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:09.006304 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:09.016025 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2bdcb3e6-fd5e-4a53-8158-16285bb50a42 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1752 microversion: 2.1 time: 0.863749 Apr 09 02:05:09.016683 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 528/1045] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:08 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1752 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:09.849616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:09.850384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:09.858768 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:09.859579 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:09.860665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:09.861386 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:10.034848 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:10.035652 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:10.043940 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:10.044676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:10.045524 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:10.046021 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:10.754748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:10.763546 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5599c0e3-ff8b-4655-b440-749bf4bfffa4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1503 microversion: 2.1 time: 0.918139 Apr 09 02:05:10.764221 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 518/1046] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:09 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1503 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:10.809131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:10.819064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2c65fdb9-1dd5-4cb6-a1a6-8fdbd12bf350 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1752 microversion: 2.1 time: 0.788274 Apr 09 02:05:10.819695 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 529/1047] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:10 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1752 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:05:11.783550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:11.784758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:11.794084 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:11.794591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:11.795453 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:11.795943 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:11.839251 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:11.840388 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:11.870857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:11.872367 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:11.873228 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:11.873720 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:12.067501 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:12.077020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-53bc7fb4-4e35-423b-a75b-232fc8d7612c tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 200 len: 1461 microversion: 2.1 time: 0.298709 Apr 09 02:05:12.077736 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 519/1048] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:11 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 1461 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:12.233273 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:12.243549 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-74efd26f-b7d5-47fa-b4b1-77723c225bf1 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.410206 Apr 09 02:05:12.244197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 530/1049] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:11 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:12.360451 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-1a527274-041a-4d56-826c-b2158d29c184 req-71c8bd9b-bc8b-4c8b-bb7a-707db71f425a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bb62f6-1103-4cc9-90d9-d8555822cf37", "name": "network-vif-deleted", "tag": "a98a9968-b6e7-44d8-8248-13c3906e4b22"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:12.362455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:12.362455 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:12.373063 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1a527274-041a-4d56-826c-b2158d29c184 req-71c8bd9b-bc8b-4c8b-bb7a-707db71f425a service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:12.373568 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-1a527274-041a-4d56-826c-b2158d29c184 req-71c8bd9b-bc8b-4c8b-bb7a-707db71f425a service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:12.391370 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-1a527274-041a-4d56-826c-b2158d29c184 req-71c8bd9b-bc8b-4c8b-bb7a-707db71f425a service nova] Creating event network-vif-deleted:a98a9968-b6e7-44d8-8248-13c3906e4b22 for instance 82bb62f6-1103-4cc9-90d9-d8555822cf37 on hv-cinder-78462 Apr 09 02:05:12.397162 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-1a527274-041a-4d56-826c-b2158d29c184 req-71c8bd9b-bc8b-4c8b-bb7a-707db71f425a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202001 Apr 09 02:05:12.397806 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 520/1050] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:05:13.096057 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:13.096717 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: 82bb62f6-1103-4cc9-90d9-d8555822cf37] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:13.105197 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:13.105710 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:13.106563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:13.107050 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:13.163118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] HTTP exception thrown: Instance 82bb62f6-1103-4cc9-90d9-d8555822cf37 could not be found. Apr 09 02:05:13.163686 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Returning 404 to user: Instance 82bb62f6-1103-4cc9-90d9-d8555822cf37 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:05:13.164639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-032be57b-9238-447f-9a76-68289d2887d4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37" status: 404 len: 111 microversion: 2.1 time: 0.072965 Apr 09 02:05:13.165279 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 531/1051] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:13 2021] GET /compute/v2.1/servers/82bb62f6-1103-4cc9-90d9-d8555822cf37 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:05:13.229407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-426020841", "imageRef": "dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4", "flavorRef": "452", "networks": [{"uuid": "f7ba46a5-7263-4935-8c1f-672d543c4652"}]}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:13.263214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:13.263889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:13.272492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:13.273005 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:13.273921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:13.274417 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:13.305739 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.network.neutron [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] validate_networks() for [('f7ba46a5-7263-4935-8c1f-672d543c4652', None, None, None)] {{(pid=99348) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 09 02:05:13.673896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:13.684344 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-238245ed-1ab1-4d79-8df4-c02166954d55 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.425528 Apr 09 02:05:13.685296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 532/1052] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:13 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:05:14.050265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Flavor limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 09 02:05:14.050813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Image limits 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 09 02:05:14.051284 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Flavor pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 09 02:05:14.051889 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Image pref 0:0:0 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 09 02:05:14.052400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.virt.hardware [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99348) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 09 02:05:14.062287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:14.062689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:14.063556 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:14.064054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:14.083065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Getting quotas for project b6edc047e08f402280f417ae3e5d83df. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 09 02:05:14.092099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.quota [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Getting quotas for user d451f2ec72504ef280582ee03a8c45c9 and project b6edc047e08f402280f417ae3e5d83df. Resources: {'cores', 'ram', 'instances'} {{(pid=99348) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 09 02:05:14.102394 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Going to run 1 instances... {{(pid=99348) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 09 02:05:14.105158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc07ba5-3ee9-4a7c-9007-1bfd794b6ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99348) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 09 02:05:14.160052 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-dbdb4878-3847-46fc-9687-ef42656787ea tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937508 Apr 09 02:05:14.160769 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 521/1053] 10.222.0.38 () {60 vars in 1137 bytes} [Fri Apr 9 02:05:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 09 02:05:14.172452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1d260b28-3d85-4bff-8946-5f838bbf7e5d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:14.173096 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1d260b28-3d85-4bff-8946-5f838bbf7e5d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:14.257354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1d260b28-3d85-4bff-8946-5f838bbf7e5d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:14.265951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1d260b28-3d85-4bff-8946-5f838bbf7e5d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1213 microversion: 2.1 time: 0.098029 Apr 09 02:05:14.266589 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 533/1054] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:14 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:14.703508 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:14.704196 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:14.712662 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:14.713160 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:14.714010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:14.714496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:14.943860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:14.960860 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4e1e83d6-ccb4-4b7e-950e-377e1c1f26a3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.261826 Apr 09 02:05:14.961498 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 522/1055] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:14 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:15.284124 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:15.285108 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:15.294336 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:15.295020 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:15.296230 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:15.296916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:15.438382 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:15.447613 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9a0a6088-1574-4377-8b82-916bb72e926f tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1265 microversion: 2.1 time: 0.167650 Apr 09 02:05:15.448564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 534/1056] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:15 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:15.979873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:15.980452 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:15.990030 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:15.990535 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:15.991395 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:15.992022 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:16.316878 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:16.327325 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-98c78442-e3f6-4940-acb9-3c26736c6011 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.352286 Apr 09 02:05:16.327961 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 523/1057] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:15 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:16.467203 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:16.468092 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:16.477200 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:16.477716 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:16.478582 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:16.479061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:16.851730 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:16.861424 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d7627e6f-2f85-452a-8448-012d7b51f06a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.398880 Apr 09 02:05:16.862820 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 535/1058] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:16 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:05:17.347281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:17.348703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:17.358248 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:17.359085 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:17.360166 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:17.360850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:17.882874 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:17.884188 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:17.906785 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:17.907699 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:17.908946 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:17.912297 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:18.066135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:18.079523 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-20dadcbc-8fb3-4745-86ab-0efa8605be39 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.736305 Apr 09 02:05:18.080778 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 524/1059] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:17 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:18.432318 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:18.442303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0d4429af-f17b-4238-8a14-15fa2e9b2569 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.564904 Apr 09 02:05:18.452647 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 536/1060] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:17 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:18.763492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-3a6b7621-2c06-4522-b094-d46e3549d1aa req-40f7fc09-b38e-41ea-9515-d4171b89ff11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e597591c-4da3-4886-b0e1-4320faf075d9", "tag": "2106cdc2-3068-4a76-a191-72044f6704b0"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:18.765354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:18.765354 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:18.774787 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3a6b7621-2c06-4522-b094-d46e3549d1aa req-40f7fc09-b38e-41ea-9515-d4171b89ff11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:18.775260 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-3a6b7621-2c06-4522-b094-d46e3549d1aa req-40f7fc09-b38e-41ea-9515-d4171b89ff11 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:18.805327 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-3a6b7621-2c06-4522-b094-d46e3549d1aa req-40f7fc09-b38e-41ea-9515-d4171b89ff11 service nova] Creating event network-changed:2106cdc2-3068-4a76-a191-72044f6704b0 for instance e597591c-4da3-4886-b0e1-4320faf075d9 on hv-cinder-78462 Apr 09 02:05:18.810418 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-3a6b7621-2c06-4522-b094-d46e3549d1aa req-40f7fc09-b38e-41ea-9515-d4171b89ff11 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050946 Apr 09 02:05:18.811223 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 525/1061] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:05:19.097876 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:19.098554 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:19.107164 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:19.107898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:19.108921 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:19.109565 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:19.461586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:19.462347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:19.470866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:19.471374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:19.472261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:19.472740 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:19.493648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:19.525147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9c2a8987-22e4-4998-91a7-12443dde8c17 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.428678 Apr 09 02:05:19.526837 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 537/1062] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:19 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:05:19.782414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:19.794502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a5147627-0135-4a63-92df-6333101577e4 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.336414 Apr 09 02:05:19.795517 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 526/1063] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:19 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:20.545123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:20.545800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:20.553880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:20.554398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:20.555246 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:20.555749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:20.755148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:20.764591 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5b255812-6b26-42ba-8389-376a51327535 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.223651 Apr 09 02:05:20.765219 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 538/1064] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:20 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:20.817319 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:20.817984 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:20.825938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:20.826448 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:20.827324 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:20.827818 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:21.029224 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:21.037965 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-73fdb643-babd-46d7-86c8-84edf547a0ed tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.224678 Apr 09 02:05:21.038586 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 527/1065] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:20 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:21.783434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:21.784054 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:21.792043 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:21.792561 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:21.793412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:21.793913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:21.994129 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:22.004434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-6902435b-e195-47ae-a792-dc4d57e8454a tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.224980 Apr 09 02:05:22.005107 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 539/1066] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:21 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:22.057093 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:22.057766 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:22.066361 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:22.066865 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:22.067701 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:22.068226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:22.266338 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:22.275038 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-accb92c9-bd4e-4d77-a32d-40ce08974de5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.222225 Apr 09 02:05:22.275741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 528/1067] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:22 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 09 02:05:23.024245 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:23.024913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:23.033496 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:23.034002 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:23.034843 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:23.035345 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:23.236607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:23.246300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-527bd2a4-4095-4040-808b-a12784870568 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.226200 Apr 09 02:05:23.246945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 540/1068] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:23 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:23.292625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:23.293295 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:23.301323 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:23.301826 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:23.302664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:23.303151 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:23.512464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:23.521288 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-c9cf785c-a141-4253-a453-32cd3a6b332e tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.232738 Apr 09 02:05:23.521922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 529/1069] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:23 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:24.265901 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:24.267130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:24.280827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:24.281337 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:24.282206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:24.282703 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:24.486857 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:24.496625 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-4ab70cbd-77e4-42b1-af68-4ba93e789062 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.235453 Apr 09 02:05:24.497912 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 541/1070] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:24 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:24.540557 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:24.541231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:24.549594 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:24.550099 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:24.550937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:24.551422 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:24.753932 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:24.762715 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-628ca985-32dd-41c7-9449-95009c59935b tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.226192 Apr 09 02:05:24.764475 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 530/1071] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:24 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:25.515759 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81a190ac-81ee-41de-8813-7a4d960ce50f] AMQP server on 10.222.0.38:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 09 02:05:25.519441 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:25.520140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:25.528385 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:25.528898 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:25.529800 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:25.530255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:25.726951 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:25.736850 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-1e7d2d90-d6b2-4ada-bba9-13ac645083f8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1757 microversion: 2.1 time: 0.222612 Apr 09 02:05:25.737671 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 542/1072] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:25 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:25.786495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:25.787207 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:25.795709 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:25.796275 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:25.797138 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:25.797638 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:26.010468 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:26.016653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-96015e70-2a6a-4968-a49f-f7bf348bbc9c req-fd522e88-bfbc-4fa1-a63a-6f4f703b8325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597591c-4da3-4886-b0e1-4320faf075d9", "name": "network-vif-plugged", "status": "completed", "tag": "2106cdc2-3068-4a76-a191-72044f6704b0"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:26.018456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:26.018456 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:26.020261 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-81a6ea4c-7c6a-41ad-844c-75e28d771b68 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.237545 Apr 09 02:05:26.021004 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 531/1073] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:25 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:26.027667 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-96015e70-2a6a-4968-a49f-f7bf348bbc9c req-fd522e88-bfbc-4fa1-a63a-6f4f703b8325 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:26.028186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-96015e70-2a6a-4968-a49f-f7bf348bbc9c req-fd522e88-bfbc-4fa1-a63a-6f4f703b8325 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:26.046399 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-96015e70-2a6a-4968-a49f-f7bf348bbc9c req-fd522e88-bfbc-4fa1-a63a-6f4f703b8325 service nova] Creating event network-vif-plugged:2106cdc2-3068-4a76-a191-72044f6704b0 for instance e597591c-4da3-4886-b0e1-4320faf075d9 on hv-cinder-78462 Apr 09 02:05:26.051669 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-96015e70-2a6a-4968-a49f-f7bf348bbc9c req-fd522e88-bfbc-4fa1-a63a-6f4f703b8325 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Apr 09 02:05:26.052339 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 543/1074] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:05:26.756135 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:26.756801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:26.764770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:26.765274 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:26.766126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:26.766607 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:26.969956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:26.979366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-db370fe4-4b2e-449e-9faf-03b8ef814b47 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1760 microversion: 2.1 time: 0.227356 Apr 09 02:05:26.980029 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 532/1075] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:26 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1760 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:27.050880 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:27.051541 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:27.060666 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:27.061172 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:27.062003 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:27.062486 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:27.119915 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] [81a190ac-81ee-41de-8813-7a4d960ce50f] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 34570. Apr 09 02:05:27.261226 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:27.269987 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-41827b54-f875-4190-bab4-f15858015085 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1313 microversion: 2.1 time: 0.234791 Apr 09 02:05:27.270619 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 544/1076] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:27 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:28.288428 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:28.289126 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:28.298239 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:28.298750 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:28.299598 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:28.300121 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:28.502366 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:28.511531 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-bde7a3b8-2e23-486f-8561-b27e9921ff4a tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1498 microversion: 2.1 time: 0.227322 Apr 09 02:05:28.512211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 533/1077] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:28 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:29.379600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:29.380186 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:29.388713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:29.389227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:29.390069 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:29.390569 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:29.456169 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Going to try to terminate instance {{(pid=99349) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:05:29.571888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5263d39c-49e9-4eff-86f1-c71fd5edd738 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 204 len: 0 microversion: 2.1 time: 0.196073 Apr 09 02:05:29.572495 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 545/1078] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:05:29 2021] DELETE /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:05:29.582192 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:29.582856 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:29.590855 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:29.591359 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:29.592231 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:29.592719 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:29.790505 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:29.800469 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d2d741de-440d-4573-ae1d-9228963966af tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1504 microversion: 2.1 time: 0.222523 Apr 09 02:05:29.801113 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 534/1079] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:29 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:30.819770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:30.820567 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:30.829152 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:30.829665 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:30.830502 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:30.831000 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:31.032827 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:31.041611 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-30247f39-ba2c-4c58-85e7-e8393d36daf5 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1504 microversion: 2.1 time: 0.226410 Apr 09 02:05:31.042243 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 546/1080] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:30 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:32.059012 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:32.059758 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:32.061091 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-856e3886-b824-496a-991e-3baa87467404 req-5e4d54ac-549a-41e9-8e9a-392156ed4bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597591c-4da3-4886-b0e1-4320faf075d9", "name": "network-vif-deleted", "tag": "2106cdc2-3068-4a76-a191-72044f6704b0"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:32.063584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:05:32.063584 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:05:32.068115 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:32.068631 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:32.069689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:32.070185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:32.072899 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-856e3886-b824-496a-991e-3baa87467404 req-5e4d54ac-549a-41e9-8e9a-392156ed4bd4 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:32.073407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-856e3886-b824-496a-991e-3baa87467404 req-5e4d54ac-549a-41e9-8e9a-392156ed4bd4 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:32.092580 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-856e3886-b824-496a-991e-3baa87467404 req-5e4d54ac-549a-41e9-8e9a-392156ed4bd4 service nova] Creating event network-vif-deleted:2106cdc2-3068-4a76-a191-72044f6704b0 for instance e597591c-4da3-4886-b0e1-4320faf075d9 on hv-cinder-78462 Apr 09 02:05:32.097693 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-856e3886-b824-496a-991e-3baa87467404 req-5e4d54ac-549a-41e9-8e9a-392156ed4bd4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040588 Apr 09 02:05:32.098234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 547/1081] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:05:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:05:32.216968 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd451f2ec72504ef280582ee03a8c45c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6edc047e08f402280f417ae3e5d83df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:05:32.226088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b8577ee2-3f46-4ef3-aeb9-3839e9a69ce0 tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 200 len: 1298 microversion: 2.1 time: 0.171104 Apr 09 02:05:32.226731 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 535/1082] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:32 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:05:33.245491 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:05:33.246263 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] [instance: e597591c-4da3-4886-b0e1-4320faf075d9] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:33.254913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:33.255425 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:33.256300 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:33.256794 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:33.311118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] HTTP exception thrown: Instance e597591c-4da3-4886-b0e1-4320faf075d9 could not be found. Apr 09 02:05:33.311788 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] Returning 404 to user: Instance e597591c-4da3-4886-b0e1-4320faf075d9 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:05:33.312741 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b33bb493-8f5a-46bc-bde9-9dd2ec0d4b9d tempest-VolumesActionsTest-329117029 tempest-VolumesActionsTest-329117029-project] 10.222.0.38 "GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9" status: 404 len: 111 microversion: 2.1 time: 0.071819 Apr 09 02:05:33.313373 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 548/1083] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:05:33 2021] GET /compute/v2.1/servers/e597591c-4da3-4886-b0e1-4320faf075d9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:05:59.438639 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-409691283"}} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:05:59.439255 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:05:59.447748 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:59.448287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:59.449130 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:05:59.450278 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:05:59.637793 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.network.security_group_api [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Removing security group 327ddccf-da8d-46ff-aec2-c29141e16f99 from port 26f38c28-3730-4979-a46b-784e868af669 Apr 09 02:06:00.339777 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3ae8fcfa-715e-4eb8-84d0-f4ead15231bb tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action" status: 202 len: 0 microversion: 2.1 time: 0.905773 Apr 09 02:06:00.340492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 536/1084] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:05:59 2021] POST /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:06:00.349896 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-5b9aec57-3fd3-4102-9c19-6d4b3a2aed28 req-10834354-e63d-4a2b-8672-efac63a536e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:06:00.351590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:06:00.351590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:06:00.361564 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5b9aec57-3fd3-4102-9c19-6d4b3a2aed28 req-10834354-e63d-4a2b-8672-efac63a536e0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:00.362064 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-5b9aec57-3fd3-4102-9c19-6d4b3a2aed28 req-10834354-e63d-4a2b-8672-efac63a536e0 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:00.380563 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-5b9aec57-3fd3-4102-9c19-6d4b3a2aed28 req-10834354-e63d-4a2b-8672-efac63a536e0 service nova] Creating event network-changed:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:06:00.385923 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-5b9aec57-3fd3-4102-9c19-6d4b3a2aed28 req-10834354-e63d-4a2b-8672-efac63a536e0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040535 Apr 09 02:06:00.386722 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 549/1085] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:06:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:06:02.343161 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:02.343916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:02.353467 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:02.354185 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:02.355106 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:02.355661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:02.537115 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.objects.instance [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lazy-loading 'services' on Instance uuid 4fedacb9-4f52-456f-a7e9-baed872327a7 {{(pid=99348) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 09 02:06:02.559058 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-6f46e9a0-f523-48c7-8499-dbd439a866e5 req-0c4a7a2c-108a-4d31-b3e9-86e123832ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:06:02.561454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:06:02.561454 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:06:02.572937 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6f46e9a0-f523-48c7-8499-dbd439a866e5 req-0c4a7a2c-108a-4d31-b3e9-86e123832ec6 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:02.573558 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6f46e9a0-f523-48c7-8499-dbd439a866e5 req-0c4a7a2c-108a-4d31-b3e9-86e123832ec6 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:02.592147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-6f46e9a0-f523-48c7-8499-dbd439a866e5 req-0c4a7a2c-108a-4d31-b3e9-86e123832ec6 service nova] Creating event network-changed:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:06:02.597614 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-6f46e9a0-f523-48c7-8499-dbd439a866e5 req-0c4a7a2c-108a-4d31-b3e9-86e123832ec6 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256415 Apr 09 02:06:02.598364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 550/1086] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:06:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:06:02.685616 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-d4e7f92d-0693-40f6-bb09-f95c6465091c tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments/d019e2b6-3cd6-4a47-b3d0-631eaae5a04d" status: 202 len: 0 microversion: 2.1 time: 0.347002 Apr 09 02:06:02.686868 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 537/1087] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 02:06:02 2021] DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments/d019e2b6-3cd6-4a47-b3d0-631eaae5a04d => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:06:02.697770 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:02.698873 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:02.708412 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:02.709763 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:02.710823 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:02.711783 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:02.791596 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-2d5c3053-0cbf-4bfc-9508-52e751917b61 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098584 Apr 09 02:06:02.792299 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 551/1088] 10.222.0.38 () {58 vars in 1292 bytes} [Fri Apr 9 02:06:02 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:06:03.805440 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:03.806661 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:03.814781 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:03.815282 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:03.816170 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:03.816657 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:03.894167 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-9b43ac7f-a69a-4ea5-acb5-e3b95e8c7640 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093496 Apr 09 02:06:03.894825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 538/1089] 10.222.0.38 () {58 vars in 1292 bytes} [Fri Apr 9 02:06:03 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:06:03.906938 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:03.907415 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:03.915971 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:03.916528 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:03.917397 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:03.917894 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:04.091240 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] HTTP exception thrown: Instance 4fedacb9-4f52-456f-a7e9-baed872327a7 is not attached to volume d019e2b6-3cd6-4a47-b3d0-631eaae5a04d Apr 09 02:06:04.092105 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Returning 404 to user: Instance 4fedacb9-4f52-456f-a7e9-baed872327a7 is not attached to volume d019e2b6-3cd6-4a47-b3d0-631eaae5a04d {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:06:04.092975 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3b194cc9-b54c-4ee1-984b-20d3e68b0dce tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments/d019e2b6-3cd6-4a47-b3d0-631eaae5a04d" status: 404 len: 154 microversion: 2.1 time: 0.191144 Apr 09 02:06:04.093588 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 552/1090] 10.222.0.38 () {58 vars in 1406 bytes} [Fri Apr 9 02:06:03 2021] DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7/os-volume_attachments/d019e2b6-3cd6-4a47-b3d0-631eaae5a04d => generated 154 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:06:05.341945 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:05.342492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:05.350349 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:05.350851 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:05.351676 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:05.352193 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:05.417028 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:06:05.530120 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a7b97b16-966e-4b2e-8600-b823b1d4dce4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 204 len: 0 microversion: 2.1 time: 0.192454 Apr 09 02:06:05.530963 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 539/1091] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:06:05 2021] DELETE /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:06:05.539648 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:05.540333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:05.548801 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:05.549303 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:05.550123 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:05.550608 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:05.759118 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:06:05.768383 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a2464d19-e12e-416c-974a-db486d175eb4 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1556 microversion: 2.1 time: 0.232831 Apr 09 02:06:05.768997 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 553/1092] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:06:05 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:06:06.788421 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:06.789184 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:06.797644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:06.798148 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:06.798978 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:06.799465 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:06.998727 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:06:07.007595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-a6a70cc4-859e-49e8-b1af-09167a247ef8 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1556 microversion: 2.1 time: 0.223781 Apr 09 02:06:07.008254 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 540/1093] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:06:06 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:06:08.025825 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:08.026384 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:08.034798 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:08.035301 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:08.036179 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:08.036670 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:08.403061 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09378cddefd5450f82183f917fd891d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2904e607b69d4a30b9f267f4947ec8f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:06:08.412466 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-0c8cb876-49a8-41c1-8479-911880213aba tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 200 len: 1556 microversion: 2.1 time: 0.390818 Apr 09 02:06:08.413068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 554/1094] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:06:08 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 1556 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:06:08.677036 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-bb78ead6-8ea4-4274-ac47-06708ffe3eee req-0b9f7e91-d274-4302-bb7c-372cb0c97f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fedacb9-4f52-456f-a7e9-baed872327a7", "name": "network-vif-deleted", "tag": "26f38c28-3730-4979-a46b-784e868af669"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:06:08.678840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:06:08.678840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:06:08.689158 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-bb78ead6-8ea4-4274-ac47-06708ffe3eee req-0b9f7e91-d274-4302-bb7c-372cb0c97f7c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:08.689737 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-bb78ead6-8ea4-4274-ac47-06708ffe3eee req-0b9f7e91-d274-4302-bb7c-372cb0c97f7c service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:08.708916 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-bb78ead6-8ea4-4274-ac47-06708ffe3eee req-0b9f7e91-d274-4302-bb7c-372cb0c97f7c service nova] Creating event network-vif-deleted:26f38c28-3730-4979-a46b-784e868af669 for instance 4fedacb9-4f52-456f-a7e9-baed872327a7 on hv-cinder-78462 Apr 09 02:06:08.714133 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-bb78ead6-8ea4-4274-ac47-06708ffe3eee req-0b9f7e91-d274-4302-bb7c-372cb0c97f7c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041110 Apr 09 02:06:08.714808 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 541/1095] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:06:09.431296 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:09.432010 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] [instance: 4fedacb9-4f52-456f-a7e9-baed872327a7] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:06:09.440420 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:09.440867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:09.441690 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:06:09.442174 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:06:09.494585 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] HTTP exception thrown: Instance 4fedacb9-4f52-456f-a7e9-baed872327a7 could not be found. Apr 09 02:06:09.495237 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Returning 404 to user: Instance 4fedacb9-4f52-456f-a7e9-baed872327a7 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:06:09.496149 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-244d6335-7731-49dd-af92-9101c427d794 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7" status: 404 len: 111 microversion: 2.1 time: 0.068950 Apr 09 02:06:09.496756 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 555/1096] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:06:09 2021] GET /compute/v2.1/servers/4fedacb9-4f52-456f-a7e9-baed872327a7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:06:09.506867 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5c1c941a-48fa-4bf6-b342-ddc57a0883c3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] Calling method '.version_select at 0x7f966d273d90>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:06:09.524653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5c1c941a-48fa-4bf6-b342-ddc57a0883c3 tempest-TestMinimumBasicScenario-1168379883 tempest-TestMinimumBasicScenario-1168379883-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1047535156" status: 202 len: 0 microversion: 2.1 time: 0.022302 Apr 09 02:06:09.525281 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 542/1097] 10.222.0.38 () {58 vars in 1262 bytes} [Fri Apr 9 02:06:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1047535156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:07:05.522630 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:07:05.523746 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:05.532347 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:05.532869 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:05.533713 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:05.534211 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:05.659191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-5deadd0f-b120-42a3-a354-8683d01cce42 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "POST /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4/action" status: 200 len: 14 microversion: 2.1 time: 0.409648 Apr 09 02:07:05.659836 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 556/1098] 10.222.0.38 () {60 vars in 1268 bytes} [Fri Apr 9 02:07:05 2021] POST /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4/action => generated 14 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 09 02:07:07.274047 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-6d67ce76-51e7-4ad0-90a7-3fdce1c7cbe2 req-cdccfd04-e72e-46b5-9db6-b166a2094c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4", "tag": "89d832cc-be13-4018-a9b8-17b29b05fe85"}]} {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:07:07.275732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:07:07.275732 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:07:07.276956 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:07.277664 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:07.287492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:07.288258 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:07.289411 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:07.289922 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:07.292840 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6d67ce76-51e7-4ad0-90a7-3fdce1c7cbe2 req-cdccfd04-e72e-46b5-9db6-b166a2094c29 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:07.293352 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-6d67ce76-51e7-4ad0-90a7-3fdce1c7cbe2 req-cdccfd04-e72e-46b5-9db6-b166a2094c29 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:07.312398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-6d67ce76-51e7-4ad0-90a7-3fdce1c7cbe2 req-cdccfd04-e72e-46b5-9db6-b166a2094c29 service nova] Creating event network-changed:89d832cc-be13-4018-a9b8-17b29b05fe85 for instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 on hv-cinder-78462 Apr 09 02:07:07.318364 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-6d67ce76-51e7-4ad0-90a7-3fdce1c7cbe2 req-cdccfd04-e72e-46b5-9db6-b166a2094c29 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048349 Apr 09 02:07:07.319068 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 557/1099] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:07:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 09 02:07:07.363723 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Going to try to terminate instance {{(pid=99348) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 09 02:07:07.484464 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-f7e9d6da-55c1-422d-b40b-54f1d9e68cbd tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "DELETE /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 204 len: 0 microversion: 2.1 time: 0.220482 Apr 09 02:07:07.488603 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 543/1100] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:07:07 2021] DELETE /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 09 02:07:07.497262 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:07.498269 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:07.508884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:07.509400 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:07.510392 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:07.510866 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:07.850814 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:07:07.861375 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-80a49b18-94d2-4a24-9c95-354f1924ecbc tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1574 microversion: 2.1 time: 0.370491 Apr 09 02:07:07.862267 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 558/1101] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:07:07 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1574 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:07:08.883414 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:08.884191 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:08.893116 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:08.893675 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:08.894533 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:08.895031 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:09.094839 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99348) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:07:09.103791 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-154e5375-7dd9-4750-b09a-aa2169117bef tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1457 microversion: 2.1 time: 0.225008 Apr 09 02:07:09.104432 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 544/1102] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:07:08 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1457 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:07:10.123545 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:10.124333 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:10.133365 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:10.133884 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:10.135067 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:10.135215 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:10.220407 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [req-34e748f7-d7b4-4464-9dba-ea7f65a7cb3d req-5e1628b9-636d-40e6-a410-46478d29deb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4", "name": "network-vif-deleted", "tag": "89d832cc-be13-4018-a9b8-17b29b05fe85"}]} {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 09 02:07:10.222102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 09 02:07:10.222102 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: warnings.warn(msg) Apr 09 02:07:10.231492 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-34e748f7-d7b4-4464-9dba-ea7f65a7cb3d req-5e1628b9-636d-40e6-a410-46478d29deb1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:10.232110 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [req-34e748f7-d7b4-4464-9dba-ea7f65a7cb3d req-5e1628b9-636d-40e6-a410-46478d29deb1 service nova] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:10.296434 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.policy [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a5b233a6884b07ad75e45ff0d67453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf79679be104ba7b95bf2c38a0760a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99349) authorize /opt/stack/nova/nova/policy.py:202}} Apr 09 02:07:10.308348 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-ed32ceaf-6ecd-4f2b-af40-1a04496abea9 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 200 len: 1391 microversion: 2.1 time: 0.188738 Apr 09 02:07:10.309214 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 559/1103] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:07:10 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 09 02:07:10.395633 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.compute.server_external_events [req-34e748f7-d7b4-4464-9dba-ea7f65a7cb3d req-5e1628b9-636d-40e6-a410-46478d29deb1 service nova] Creating event network-vif-deleted:89d832cc-be13-4018-a9b8-17b29b05fe85 for instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 on hv-cinder-78462 Apr 09 02:07:10.400960 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [req-34e748f7-d7b4-4464-9dba-ea7f65a7cb3d req-5e1628b9-636d-40e6-a410-46478d29deb1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185241 Apr 09 02:07:10.401821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 545/1104] 10.222.0.38 () {64 vars in 1308 bytes} [Fri Apr 9 02:07:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 09 02:07:11.327140 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:11.327704 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:11.336309 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:11.336821 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:11.337660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:11.338157 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:11.391644 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] HTTP exception thrown: Instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 could not be found. Apr 09 02:07:11.392374 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Returning 404 to user: Instance f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:07:11.393265 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-42ff1e6e-56c7-493b-8292-d0e4386b5454 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4" status: 404 len: 111 microversion: 2.1 time: 0.070351 Apr 09 02:07:11.393870 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 560/1105] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:07:11 2021] GET /compute/v2.1/servers/f7f3e090-9a4c-4283-b6ff-d2dff56e4cd4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:07:12.322813 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:12.323550 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99348) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:12.332276 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:12.332749 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:12.333577 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:12.334065 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99348) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:12.386396 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] HTTP exception thrown: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. Apr 09 02:07:12.387051 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Returning 404 to user: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. {{(pid=99348) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:07:12.387941 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-b2bc0a00-6e1c-4f7e-9e1e-a2cea459ba27 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 404 len: 111 microversion: 2.1 time: 0.069788 Apr 09 02:07:12.388575 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 546/1106] 10.222.0.38 () {58 vars in 1229 bytes} [Fri Apr 9 02:07:12 2021] DELETE /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:07:12.397927 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '>' {{(pid=99349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:12.398595 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.compute.api [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] [instance: b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd] Fetching instance by UUID {{(pid=99349) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 09 02:07:12.407685 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:12.408227 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:12.409458 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 09 02:07:12.409597 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG oslo_concurrency.lockutils [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Lock "1fd6123a-d6c7-4733-89a5-8079297c7441" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99349) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 09 02:07:12.462147 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.wsgi [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] HTTP exception thrown: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. Apr 09 02:07:12.463512 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Returning 404 to user: Instance b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd could not be found. {{(pid=99349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 09 02:07:12.464653 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-3c4d089c-c43d-4132-a5e9-64dfbb080061 tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd" status: 404 len: 111 microversion: 2.1 time: 0.070949 Apr 09 02:07:12.465283 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99349|app: 0|req: 561/1107] 10.222.0.38 () {58 vars in 1226 bytes} [Fri Apr 9 02:07:12 2021] GET /compute/v2.1/servers/b86e0ce7-1e6d-4bc3-9b42-f7fbac850bbd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 09 02:07:13.911398 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: DEBUG nova.api.openstack.wsgi [None req-30a1f48e-7d7f-454c-b816-58731be9cc7f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] Calling method '.version_select at 0x7f966ddf8f28>' {{(pid=99348) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 09 02:07:13.929066 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO nova.api.openstack.requestlog [None req-30a1f48e-7d7f-454c-b816-58731be9cc7f tempest-TestVolumeBootPattern-1531648134 tempest-TestVolumeBootPattern-1531648134-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2115141322" status: 202 len: 0 microversion: 2.1 time: 0.022209 Apr 09 02:07:13.929689 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: [pid: 99348|app: 0|req: 547/1108] 10.222.0.38 () {58 vars in 1253 bytes} [Fri Apr 9 02:07:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2115141322 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 09 02:07:51.420480 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:07:51.421027 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:07:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:08:17.412206 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:08:17.412807 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:08:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:09:23.889600 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:09:23.890088 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:09:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:09:34.144888 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:09:34.145913 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:09:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:09:52.803590 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:09:52.804287 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:09:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:10:03.531660 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:10:03.532234 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:10:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:11:11.437553 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:11:11.438131 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:11:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 09 02:11:37.429574 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 09 02:11:37.430249 dv-cinder-784623-6-iscsi devstack@n-api.service[99347]: Fri Apr 9 02:11:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!